2024-09-11T14:27:50.119 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T14:27:50.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:27:50.220 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369 branch: main description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7901369' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore ompap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd objectstore: seastore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a workunit: branch: wip-matanb-crimson-seastore-logs env: CRIMSON_COMPAT: '1' sha1: dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 5813 sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-matanb-crimson-seastore-logs suite_path: /home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa suite_relpath: qa suite_repo: https://github.com/matan-b/ceph.git suite_sha1: dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzRn0lMGhlT2LdcaP+MUNHJcz9qTV5JWtOvy6rbdevBvfZUjBjwmoDViR21wmzmUndgccA72i6w+Blw7x9FJi0= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzXypM7P52WgmhQ88tXpo0Ro/mpKcn/ueeg3f0aMYua9oaEdxZJsSlzcFRyiNpasZQKjqP9doPXIH/IgTl7DvM= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_13:56:22 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T14:27:50.220 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa; will attempt to use it 2024-09-11T14:27:50.221 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa/tasks 2024-09-11T14:27:50.221 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T14:27:50.222 INFO:teuthology.task.internal:Checking packages... 2024-09-11T14:27:50.246 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '0d61375b8ab53be4c233f5b93e463edfdff9316a' 2024-09-11T14:27:50.247 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T14:27:50.247 INFO:teuthology.packaging:ref: None 2024-09-11T14:27:50.247 INFO:teuthology.packaging:tag: None 2024-09-11T14:27:50.247 INFO:teuthology.packaging:branch: main 2024-09-11T14:27:50.247 INFO:teuthology.packaging:sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:27:50.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-11T14:27:50.461 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4872.g0d61375b 2024-09-11T14:27:50.463 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T14:27:50.469 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T14:27:50.469 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T14:27:50.516 INFO:teuthology.task.internal:Saving configuration 2024-09-11T14:27:50.528 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T14:27:50.550 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T14:27:50.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 14:22:53.192164', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzRn0lMGhlT2LdcaP+MUNHJcz9qTV5JWtOvy6rbdevBvfZUjBjwmoDViR21wmzmUndgccA72i6w+Blw7x9FJi0='} 2024-09-11T14:27:50.598 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 14:22:53.193572', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzXypM7P52WgmhQ88tXpo0Ro/mpKcn/ueeg3f0aMYua9oaEdxZJsSlzcFRyiNpasZQKjqP9doPXIH/IgTl7DvM='} 2024-09-11T14:27:50.598 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T14:27:50.604 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-11T14:27:50.604 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T14:27:50.604 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T14:27:50.681 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3f1e213ac0>, signals=[15]) 2024-09-11T14:27:50.681 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T14:27:50.687 INFO:teuthology.task.internal:Opening connections... 2024-09-11T14:27:50.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:27:50.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:27:50.773 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:27:50.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:27:50.850 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T14:27:50.856 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-11T14:27:50.874 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-11T14:27:50.875 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-11T14:27:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-11T14:27:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-11T14:27:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-11T14:27:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:27:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-11T14:27:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:27:50.933 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:27:50.934 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-11T14:27:50.956 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-09-11T14:27:50.976 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-09-11T14:27:50.977 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-09-11T14:27:51.034 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-09-11T14:27:51.034 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-09-11T14:27:51.034 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-09-11T14:27:51.034 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:27:51.034 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-09-11T14:27:51.034 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:27:51.035 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:27:51.035 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-09-11T14:27:51.056 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T14:27:51.064 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T14:27:51.091 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T14:27:51.092 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:27:51.094 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:27:51.111 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T14:27:51.124 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T14:27:51.124 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:27:51.152 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:27:51.173 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T14:27:51.230 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T14:27:51.244 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-11T14:27:51.244 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-11T14:27:51.244 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:27:51.245 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:27:51.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:27:51.261 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-11T14:27:51.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:27:51.263 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-11T14:27:51.318 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:27:51.319 INFO:teuthology.task.kernel:Running kernel on smithi143: 5.14.0-503.el9.x86_64 2024-09-11T14:27:51.319 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum install -y kernel 2024-09-11T14:27:51.320 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:27:51.320 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-503.el9.x86_64 2024-09-11T14:27:51.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-09-11T14:27:53.735 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T14:27:55.848 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-11T14:27:57.119 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-11T14:27:57.774 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-11T14:28:01.586 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T14:28:04.120 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-11T14:28:04.133 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-11T14:28:05.008 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T14:28:05.617 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-11T14:28:06.421 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-11T14:28:10.564 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T14:28:12.144 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T14:28:12.595 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:28:12.596 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:28:12.679 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:28:12.692 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:28:12.693 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:28:12.693 INFO:teuthology.orchestra.run.smithi143.stdout:Install 4 Packages 2024-09-11T14:28:12.693 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:28:12.693 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 79 M 2024-09-11T14:28:12.693 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 126 M 2024-09-11T14:28:12.693 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:28:12.807 INFO:teuthology.orchestra.run.smithi143.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 247 kB/s | 23 kB 00:00 2024-09-11T14:28:13.316 INFO:teuthology.orchestra.run.smithi143.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-11T14:28:13.708 INFO:teuthology.orchestra.run.smithi143.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 35 MB/s | 35 MB 00:00 2024-09-11T14:28:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-11T14:28:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:28:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-11T14:28:14.200 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:28:14.200 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:28:14.302 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:28:14.313 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:28:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:28:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:Install 4 Packages 2024-09-11T14:28:14.314 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:28:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 79 M 2024-09-11T14:28:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 126 M 2024-09-11T14:28:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:28:14.537 INFO:teuthology.orchestra.run.smithi052.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 185 kB/s | 23 kB 00:00 2024-09-11T14:28:14.829 INFO:teuthology.orchestra.run.smithi052.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-11T14:28:14.835 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:28:15.189 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:28:15.189 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:28:15.371 INFO:teuthology.orchestra.run.smithi052.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 34 MB/s | 29 MB 00:00 2024-09-11T14:28:15.729 INFO:teuthology.orchestra.run.smithi052.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-11T14:28:15.730 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:28:15.730 INFO:teuthology.orchestra.run.smithi052.stdout:Total 56 MB/s | 79 MB 00:01 2024-09-11T14:28:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:28:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:28:16.439 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:28:16.823 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:28:16.823 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:28:17.798 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:28:17.799 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:28:18.611 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:28:19.464 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:28:19.562 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:28:20.363 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:28:21.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:28:21.130 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:28:22.352 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:28:22.479 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:28:23.920 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:28:24.045 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:28:27.290 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:28:27.329 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:28:29.165 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:28:29.210 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:28:32.186 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:28:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:10.496 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:10.535 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:10.933 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:10.934 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:29:10.934 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:29:10.934 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:29:11.836 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:29:11.837 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:29:12.169 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:29:12.251 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:29:12.252 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:29:12.252 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:29:12.252 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:29:12.252 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:29:12.252 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-11T14:29:12.252 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi143.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:29:12.252 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:29:12.310 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:29:12.310 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:29:12.311 DEBUG:teuthology.orchestra.run.smithi143:> sudo rpm -qi grub2-tools 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Name : grub2-tools 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Epoch : 1 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Version : 2.06 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Release : 82.el9 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: x86_64 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Group : Unspecified 2024-09-11T14:29:12.343 INFO:teuthology.orchestra.run.smithi143.stdout:Size : 8274670 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:License : GPLv3+ 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Packager : builder@centos.org 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Vendor : CentOS 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Summary : Support tools for GRUB. 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:Description : 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:29:12.344 INFO:teuthology.orchestra.run.smithi143.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:29:12.345 INFO:teuthology.orchestra.run.smithi143.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:29:12.345 INFO:teuthology.orchestra.run.smithi143.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:29:12.345 INFO:teuthology.orchestra.run.smithi143.stdout:hardware devices. 2024-09-11T14:29:12.345 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:29:12.345 INFO:teuthology.orchestra.run.smithi143.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:29:12.346 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:29:12.346 INFO:teuthology.task.kernel:Updating grub on smithi143 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:29:12.346 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:29:13.048 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-09-11T14:29:13.406 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:13.446 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:13.739 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:13.739 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:29:13.739 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:29:13.739 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:29:14.405 INFO:teuthology.orchestra.run.smithi143.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:29:14.425 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-09-11T14:29:14.427 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-09-11T14:29:14.443 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.5WWl3yAg1O 2024-09-11T14:29:14.443 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5WWl3yAg1O 2024-09-11T14:29:14.510 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.5WWl3yAg1O 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:29:14.570 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:29:14.648 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.5WWl3yAg1O is 6KB 2024-09-11T14:29:14.697 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.5WWl3yAg1O 2024-09-11T14:29:14.712 DEBUG:teuthology.orchestra.run.smithi143:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:29:14.786 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:29:14.786 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:29:14.786 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:29:14.786 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:29:14.787 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:29:14.904 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:29:14.918 DEBUG:teuthology.orchestra.run.smithi143:> sudo shutdown -r now 2024-09-11T14:29:14.990 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:29:14.990 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:29:14.990 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:29:14.990 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:29:14.990 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:29:14.990 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T14:29:14.991 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:29:14.991 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:29:15.049 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:29:15.049 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:29:15.049 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-09-11T14:29:15.084 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-09-11T14:29:15.084 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-09-11T14:29:15.084 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-09-11T14:29:15.084 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 82.el9 2024-09-11T14:29:15.084 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-09-11T14:29:15.084 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8274670 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-09-11T14:29:15.085 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:29:15.086 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:29:15.086 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:29:15.086 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:29:15.086 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-09-11T14:29:15.086 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:29:15.086 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:29:15.087 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:29:15.087 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:29:15.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:29:15.750 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-11T14:29:17.091 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:29:17.127 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-11T14:29:17.129 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-11T14:29:17.144 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.0nj5TJEHmw 2024-09-11T14:29:17.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0nj5TJEHmw 2024-09-11T14:29:17.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.0nj5TJEHmw 2024-09-11T14:29:17.360 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.0nj5TJEHmw is 6KB 2024-09-11T14:29:17.412 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.0nj5TJEHmw 2024-09-11T14:29:17.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:29:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:29:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:29:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:29:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:29:17.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:29:17.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-11T14:29:44.944 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-11T14:29:44.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-11T14:29:44.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:29:47.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T14:29:47.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-11T14:29:47.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:30:06.141 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-09-11T14:30:15.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-11T14:30:15.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:30:19.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-09-11T14:30:28.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-11T14:30:28.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:30:46.845 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-09-11T14:30:58.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-11T14:30:58.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:30:59.283 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-11T14:30:59.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-11T14:30:59.639 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:30:59.639 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-11T14:30:59.654 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:30:59.654 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:30:59.655 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:30:59.655 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:31:00.656 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-11T14:31:00.657 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:31:00.743 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2024-09-11T14:31:00.774 DEBUG:teuthology.parallel:result is None 2024-09-11T14:31:15.153 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T14:31:27.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-11T14:31:27.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:31:27.528 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-11T14:31:27.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-11T14:31:27.895 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:31:27.895 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-11T14:31:27.911 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:31:27.911 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:31:27.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:31:27.911 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:31:28.912 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T14:31:28.913 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:31:28.981 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-09-11T14:31:29.004 DEBUG:teuthology.parallel:result is None 2024-09-11T14:31:29.004 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T14:31:29.106 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T14:31:29.106 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:31:29.109 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:31:29.128 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T14:31:29.134 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T14:31:29.174 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T14:31:29.174 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:31:29.177 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:31:29.286 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T14:31:29.293 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T14:31:29.293 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:31:29.296 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:31:29.330 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:31:29.336 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:31:29.341 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:31:29.348 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:31:29.349 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T14:31:29.358 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T14:31:29.358 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:31:29.392 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:31:29.420 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T14:31:29.431 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T14:31:29.432 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:31:29.462 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:31:29.479 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:31:29.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:31:29.615 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:31:29.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:31:29.749 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:31:29.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:31:29.820 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:31:29.867 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:31:29.918 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:31:30.007 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:31:30.046 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:31:30.046 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:31:30.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-11T14:31:30.115 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-09-11T14:31:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:31:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:31:30.713 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T14:31:30.720 INFO:teuthology.task.internal:Starting timer... 2024-09-11T14:31:30.720 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T14:31:30.786 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T14:31:30.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-11T14:31:30.886 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-11T14:31:30.888 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-09-11T14:31:30.943 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-09-11T14:31:30.945 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T14:31:30.946 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-11T14:31:30.975 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-11T14:31:30.975 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-09-11T14:31:31.010 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-09-11T14:31:31.011 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi143.front.sepia.ceph.com': 'permissive'} 2024-09-11T14:31:31.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:31:31.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:31:31.046 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:31:31.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:31:31.079 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T14:31:31.080 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:31:31.118 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:31:31.157 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T14:31:31.166 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T14:31:31.169 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T14:31:31.317 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T14:31:31.329 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T14:31:31.330 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T14:35:13.623 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2024-09-11T14:35:13.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-11T14:35:13.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:35:13.703 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-11T14:35:13.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-11T14:35:13.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-11T14:35:13.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:35:13.864 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-11T14:35:13.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-11T14:35:13.943 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T14:35:13.953 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T14:35:13.953 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:35:13.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:35:13.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:35:13.956 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:35:13.984 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:35:13.998 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:35:14.011 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:35:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-11T14:35:14.025 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:35:14.035 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-11T14:35:14.050 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:35:14.050 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-09-11T14:35:14.061 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-09-11T14:35:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:35:14.075 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:35:14.092 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:35:14.123 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:35:14.126 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:35:14.126 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-11T14:35:14.126 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.126 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.127 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.127 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.145 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:35:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:35:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-11T14:35:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.150 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:35:14.151 INFO:teuthology.run_tasks:Running task install... 2024-09-11T14:35:14.265 DEBUG:teuthology.task.install:project ceph 2024-09-11T14:35:14.266 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-11T14:35:14.266 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'} 2024-09-11T14:35:14.266 INFO:teuthology.task.install:Using flavor: crimson 2024-09-11T14:35:14.272 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T14:35:14.272 INFO:teuthology.task.install:extra packages: [] 2024-09-11T14:35:14.272 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'tag': None, 'wait_for_package': False} 2024-09-11T14:35:14.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:35:14.275 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'tag': None, 'wait_for_package': False} 2024-09-11T14:35:14.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:35:14.422 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/ 2024-09-11T14:35:14.422 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4872.g0d61375b 2024-09-11T14:35:14.426 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/ 2024-09-11T14:35:14.426 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4872.g0d61375b 2024-09-11T14:35:14.536 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:35:14.536 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:35:14.536 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:35:14.547 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/0d61375b8ab53be4c233f5b93e463edfdff9316a/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:35:14.547 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:35:14.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:35:14.563 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:35:14.563 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0d61375b8ab53be4c233f5b93e463edfdff9316a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:35:14.575 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:35:14.575 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0d61375b8ab53be4c233f5b93e463edfdff9316a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:35:14.628 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:35:14.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:35:14.704 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:35:14.719 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:35:14.769 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-09-11T14:35:14.770 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-09-11T14:35:14.784 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-11T14:35:14.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-11T14:35:14.998 INFO:teuthology.orchestra.run.smithi143.stdout:45 files removed 2024-09-11T14:35:15.018 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-11T14:35:15.026 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw 2024-09-11T14:35:15.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw 2024-09-11T14:35:15.582 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 326 kB/s | 89 kB 00:00 2024-09-11T14:35:15.614 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 328 kB/s | 89 kB 00:00 2024-09-11T14:35:15.891 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-11T14:35:15.906 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-11T14:35:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 8.4 kB/s | 2.1 kB 00:00 2024-09-11T14:35:16.182 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 8.8 kB/s | 2.1 kB 00:00 2024-09-11T14:35:18.082 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-11T14:35:18.592 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.2 MB 00:02 2024-09-11T14:35:20.635 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-11T14:35:26.260 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-11T14:35:27.736 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-11T14:35:28.806 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-11T14:35:34.204 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-11T14:35:35.732 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-11T14:35:36.565 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:35:36.585 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:35:36.585 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:35:36.585 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:35:36.585 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 10 M 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.8 M 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.1 M 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 20 M 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 25 k 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 808 k 2024-09-11T14:35:36.586 INFO:teuthology.orchestra.run.smithi143.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 558 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.4 M 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 45 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 143 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 159 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:35:36.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 316 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 303 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 99 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout:Installing weak dependencies: 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout:Install 31 Packages 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 2 Packages 2024-09-11T14:35:36.588 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:35:36.589 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 60 M 2024-09-11T14:35:36.589 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:35:37.630 INFO:teuthology.orchestra.run.smithi143.stdout:(1/33): ceph-base-19.3.0-4872.g0d61375b.el9.x86 6.3 MB/s | 6.1 MB 00:00 2024-09-11T14:35:37.707 INFO:teuthology.orchestra.run.smithi143.stdout:(2/33): ceph-selinux-19.3.0-4872.g0d61375b.el9. 326 kB/s | 25 kB 00:00 2024-09-11T14:35:37.841 INFO:teuthology.orchestra.run.smithi143.stdout:(3/33): libcephfs2-19.3.0-4872.g0d61375b.el9.x8 5.9 MB/s | 808 kB 00:00 2024-09-11T14:35:37.933 INFO:teuthology.orchestra.run.smithi143.stdout:(4/33): libradosstriper1-19.3.0-4872.g0d61375b. 6.0 MB/s | 558 kB 00:00 2024-09-11T14:35:38.050 INFO:teuthology.orchestra.run.smithi143.stdout:(5/33): ceph-radosgw-19.3.0-4872.g0d61375b.el9. 7.5 MB/s | 10 MB 00:01 2024-09-11T14:35:38.125 INFO:teuthology.orchestra.run.smithi143.stdout:(6/33): python3-ceph-argparse-19.3.0-4872.g0d61 605 kB/s | 45 kB 00:00 2024-09-11T14:35:38.208 INFO:teuthology.orchestra.run.smithi143.stdout:(7/33): python3-ceph-common-19.3.0-4872.g0d6137 1.7 MB/s | 143 kB 00:00 2024-09-11T14:35:38.284 INFO:teuthology.orchestra.run.smithi143.stdout:(8/33): python3-cephfs-19.3.0-4872.g0d61375b.el 2.1 MB/s | 159 kB 00:00 2024-09-11T14:35:38.359 INFO:teuthology.orchestra.run.smithi143.stdout:(9/33): python3-rados-19.3.0-4872.g0d61375b.el9 4.1 MB/s | 316 kB 00:00 2024-09-11T14:35:38.451 INFO:teuthology.orchestra.run.smithi143.stdout:(10/33): python3-rbd-19.3.0-4872.g0d61375b.el9. 3.2 MB/s | 303 kB 00:00 2024-09-11T14:35:38.526 INFO:teuthology.orchestra.run.smithi143.stdout:(11/33): librgw2-19.3.0-4872.g0d61375b.el9.x86_ 9.1 MB/s | 5.4 MB 00:00 2024-09-11T14:35:38.560 INFO:teuthology.orchestra.run.smithi143.stdout:(12/33): python3-rgw-19.3.0-4872.g0d61375b.el9. 913 kB/s | 99 kB 00:00 2024-09-11T14:35:38.752 INFO:teuthology.orchestra.run.smithi143.stdout:(13/33): ceph-common-19.3.0-4872.g0d61375b.el9. 9.5 MB/s | 20 MB 00:02 2024-09-11T14:35:38.836 INFO:teuthology.orchestra.run.smithi143.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 346 kB/s | 107 kB 00:00 2024-09-11T14:35:38.906 INFO:teuthology.orchestra.run.smithi143.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 644 kB/s | 45 kB 00:00 2024-09-11T14:35:38.936 INFO:teuthology.orchestra.run.smithi143.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 453 kB/s | 171 kB 00:00 2024-09-11T14:35:38.978 INFO:teuthology.orchestra.run.smithi143.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 710 kB/s | 160 kB 00:00 2024-09-11T14:35:39.020 INFO:teuthology.orchestra.run.smithi143.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-11T14:35:39.045 INFO:teuthology.orchestra.run.smithi143.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 631 kB/s | 42 kB 00:00 2024-09-11T14:35:39.071 INFO:teuthology.orchestra.run.smithi143.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-11T14:35:39.096 INFO:teuthology.orchestra.run.smithi143.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-11T14:35:39.113 INFO:teuthology.orchestra.run.smithi143.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 534 kB/s | 36 kB 00:00 2024-09-11T14:35:39.130 INFO:teuthology.orchestra.run.smithi143.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 805 kB/s | 47 kB 00:00 2024-09-11T14:35:39.189 INFO:teuthology.orchestra.run.smithi143.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.3 MB/s | 309 kB 00:00 2024-09-11T14:35:39.205 INFO:teuthology.orchestra.run.smithi143.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 3.3 MB/s | 49 kB 00:00 2024-09-11T14:35:39.223 INFO:teuthology.orchestra.run.smithi143.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 337 kB/s | 26 kB 00:00 2024-09-11T14:35:39.248 INFO:teuthology.orchestra.run.smithi143.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T14:35:39.281 INFO:teuthology.orchestra.run.smithi143.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T14:35:39.323 INFO:teuthology.orchestra.run.smithi143.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-11T14:35:39.382 INFO:teuthology.orchestra.run.smithi143.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T14:35:39.457 INFO:teuthology.orchestra.run.smithi143.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-11T14:35:40.116 INFO:teuthology.orchestra.run.smithi143.stdout:(32/33): librados2-19.3.0-4872.g0d61375b.el9.x8 4.4 MB/s | 3.5 MB 00:00 2024-09-11T14:35:40.183 INFO:teuthology.orchestra.run.smithi143.stdout:(33/33): librbd1-19.3.0-4872.g0d61375b.el9.x86_ 4.7 MB/s | 3.8 MB 00:00 2024-09-11T14:35:40.188 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:40.188 INFO:teuthology.orchestra.run.smithi143.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-11T14:35:40.274 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T14:35:40.300 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:35:40.337 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:35:40.337 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:35:40.998 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:35:40.999 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:35:41.767 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 19 kB 00:00 2024-09-11T14:35:42.540 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:35:42.581 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-11T14:35:43.066 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:35:43.118 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:35:43.211 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:35:43.299 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:35:43.328 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:35:43.391 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:35:43.437 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:35:43.483 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:35:43.508 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:35:43.531 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:35:43.565 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:35:43.772 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:35:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:35:43.841 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:35:43.884 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 11/35 2024-09-11T14:35:43.913 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:35:44.003 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:35:44.027 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:35:44.116 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:35:44.168 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:35:44.281 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:35:44.328 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:35:44.378 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:35:44.418 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:35:44.464 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:35:44.529 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:35:44.895 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:35:44.943 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:35:45.017 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:35:45.048 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 24/35 2024-09-11T14:35:45.084 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:35:45.668 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:35:45.695 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:35:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:35:45.836 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 28/35 2024-09-11T14:35:45.873 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 29/35 2024-09-11T14:35:48.187 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T14:35:48.316 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:35:48.353 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:35:49.047 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:35:49.090 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:35:49.181 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:35:49.182 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:35:49.182 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:35:49.182 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:35:49.225 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:35:50.674 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:35:50.687 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:35:50.687 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:35:50.687 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 10 M 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.8 M 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.1 M 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 20 M 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 25 k 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:35:50.688 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 808 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 558 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.4 M 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:35:50.689 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 45 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 143 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 159 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 316 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 303 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 99 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:35:50.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout:Install 31 Packages 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 60 M 2024-09-11T14:35:50.691 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:35:51.630 INFO:teuthology.orchestra.run.smithi052.stdout:(1/33): ceph-base-19.3.0-4872.g0d61375b.el9.x86 9.7 MB/s | 6.1 MB 00:00 2024-09-11T14:35:51.681 INFO:teuthology.orchestra.run.smithi052.stdout:(2/33): ceph-selinux-19.3.0-4872.g0d61375b.el9. 503 kB/s | 25 kB 00:00 2024-09-11T14:35:51.772 INFO:teuthology.orchestra.run.smithi052.stdout:(3/33): libcephfs2-19.3.0-4872.g0d61375b.el9.x8 8.7 MB/s | 808 kB 00:00 2024-09-11T14:35:51.864 INFO:teuthology.orchestra.run.smithi052.stdout:(4/33): libradosstriper1-19.3.0-4872.g0d61375b. 6.0 MB/s | 558 kB 00:00 2024-09-11T14:35:51.973 INFO:teuthology.orchestra.run.smithi052.stdout:(5/33): ceph-radosgw-19.3.0-4872.g0d61375b.el9. 11 MB/s | 10 MB 00:00 2024-09-11T14:35:52.023 INFO:teuthology.orchestra.run.smithi052.stdout:(6/33): python3-ceph-argparse-19.3.0-4872.g0d61 909 kB/s | 45 kB 00:00 2024-09-11T14:35:52.081 INFO:teuthology.orchestra.run.smithi052.stdout:(7/33): python3-ceph-common-19.3.0-4872.g0d6137 2.4 MB/s | 143 kB 00:00 2024-09-11T14:35:52.149 INFO:teuthology.orchestra.run.smithi052.stdout:(8/33): python3-cephfs-19.3.0-4872.g0d61375b.el 2.3 MB/s | 159 kB 00:00 2024-09-11T14:35:52.265 INFO:teuthology.orchestra.run.smithi052.stdout:(9/33): librgw2-19.3.0-4872.g0d61375b.el9.x86_6 13 MB/s | 5.4 MB 00:00 2024-09-11T14:35:52.291 INFO:teuthology.orchestra.run.smithi052.stdout:(10/33): python3-rados-19.3.0-4872.g0d61375b.el 2.2 MB/s | 316 kB 00:00 2024-09-11T14:35:52.316 INFO:teuthology.orchestra.run.smithi052.stdout:(11/33): python3-rbd-19.3.0-4872.g0d61375b.el9. 5.9 MB/s | 303 kB 00:00 2024-09-11T14:35:52.591 INFO:teuthology.orchestra.run.smithi052.stdout:(12/33): ceph-common-19.3.0-4872.g0d61375b.el9. 12 MB/s | 20 MB 00:01 2024-09-11T14:35:52.616 INFO:teuthology.orchestra.run.smithi052.stdout:(13/33): python3-rgw-19.3.0-4872.g0d61375b.el9. 305 kB/s | 99 kB 00:00 2024-09-11T14:35:52.725 INFO:teuthology.orchestra.run.smithi052.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 263 kB/s | 107 kB 00:00 2024-09-11T14:35:52.758 INFO:teuthology.orchestra.run.smithi052.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-11T14:35:52.784 INFO:teuthology.orchestra.run.smithi052.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-11T14:35:52.817 INFO:teuthology.orchestra.run.smithi052.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 800 kB/s | 160 kB 00:00 2024-09-11T14:35:52.885 INFO:teuthology.orchestra.run.smithi052.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-11T14:35:52.910 INFO:teuthology.orchestra.run.smithi052.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 458 kB/s | 42 kB 00:00 2024-09-11T14:35:52.935 INFO:teuthology.orchestra.run.smithi052.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-11T14:35:52.960 INFO:teuthology.orchestra.run.smithi052.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-11T14:35:52.986 INFO:teuthology.orchestra.run.smithi052.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-11T14:35:53.011 INFO:teuthology.orchestra.run.smithi052.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-11T14:35:53.069 INFO:teuthology.orchestra.run.smithi052.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T14:35:53.112 INFO:teuthology.orchestra.run.smithi052.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-11T14:35:53.137 INFO:teuthology.orchestra.run.smithi052.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 237 kB/s | 26 kB 00:00 2024-09-11T14:35:53.153 INFO:teuthology.orchestra.run.smithi052.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T14:35:53.179 INFO:teuthology.orchestra.run.smithi052.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-11T14:35:53.238 INFO:teuthology.orchestra.run.smithi052.stdout:(29/33): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-11T14:35:53.271 INFO:teuthology.orchestra.run.smithi052.stdout:(30/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-11T14:35:53.355 INFO:teuthology.orchestra.run.smithi052.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T14:35:53.522 INFO:teuthology.orchestra.run.smithi052.stdout:(32/33): librbd1-19.3.0-4872.g0d61375b.el9.x86_ 15 MB/s | 3.8 MB 00:00 2024-09-11T14:35:53.580 INFO:teuthology.orchestra.run.smithi052.stdout:(33/33): librados2-19.3.0-4872.g0d61375b.el9.x8 10 MB/s | 3.5 MB 00:00 2024-09-11T14:35:53.586 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:35:53.586 INFO:teuthology.orchestra.run.smithi052.stdout:Total 21 MB/s | 60 MB 00:02 2024-09-11T14:35:53.710 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:35:53.753 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:35:53.753 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:35:54.443 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:35:54.444 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:35:55.981 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:35:56.513 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:35:56.565 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:35:56.644 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:35:56.750 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:35:56.775 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:35:56.838 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:35:56.884 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:35:56.913 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:35:56.938 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:35:56.961 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:35:56.992 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:35:57.195 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:35:57.227 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:35:57.262 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:35:57.306 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 11/35 2024-09-11T14:35:57.335 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:35:57.426 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:35:57.456 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:35:57.528 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 14/35 2024-09-11T14:35:57.564 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:35:57.676 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:35:57.709 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:35:57.760 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:35:57.797 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:35:57.826 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:35:57.867 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:35:58.246 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:35:58.296 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:35:58.388 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 23/35 2024-09-11T14:35:58.418 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 24/35 2024-09-11T14:35:58.454 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:35:59.067 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:35:59.090 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:35:59.154 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 27/35 2024-09-11T14:35:59.235 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 28/35 2024-09-11T14:35:59.267 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 29/35 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-09-11T14:35:59.596 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-09-11T14:35:59.597 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:00.697 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:36:00.722 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:36:00.722 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:00.722 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:36:00.722 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:36:00.722 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:36:00.722 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:00.724 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:36:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:36:01.890 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:36:01.922 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:36:02.161 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:36:02.161 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 1/35 2024-09-11T14:36:02.161 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:36:02.161 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:36:02.161 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:36:02.161 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 5/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 6/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 7/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 8/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 9/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 10/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 11/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 13/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:36:02.162 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:36:02.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:36:02.164 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:36:02.164 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:36:02.164 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 34/35 2024-09-11T14:36:02.650 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 30/35 2024-09-11T14:36:02.692 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:36:02.785 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 31/35 2024-09-11T14:36:02.785 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:36:02.785 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:36:02.785 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:02.818 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:36:03.118 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:36:03.118 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:03.118 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-09-11T14:36:03.118 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:36:03.119 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.120 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:03.121 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:36:03.489 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-test 2024-09-11T14:36:04.057 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:30 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:36:04.189 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:36:04.190 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:36:04.190 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:04.190 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:36:04.190 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 85 M 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 175 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:36:04.191 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:04.192 INFO:teuthology.orchestra.run.smithi143.stdout:Install 9 Packages 2024-09-11T14:36:04.192 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:04.192 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 87 M 2024-09-11T14:36:04.192 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 797 M 2024-09-11T14:36:04.192 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:36:05.155 INFO:teuthology.orchestra.run.smithi143.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 762 kB/s | 94 kB 00:00 2024-09-11T14:36:05.255 INFO:teuthology.orchestra.run.smithi143.stdout:(2/9): libcephsqlite-19.3.0-4872.g0d61375b.el9. 781 kB/s | 175 kB 00:00 2024-09-11T14:36:06.056 INFO:teuthology.orchestra.run.smithi143.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 228 kB/s | 183 kB 00:00 2024-09-11T14:36:06.097 INFO:teuthology.orchestra.run.smithi143.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 545 kB/s | 513 kB 00:00 2024-09-11T14:36:06.964 INFO:teuthology.orchestra.run.smithi143.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 351 kB/s | 304 kB 00:00 2024-09-11T14:36:07.106 INFO:teuthology.orchestra.run.smithi143.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 984 kB/s | 1.0 MB 00:01 2024-09-11T14:36:07.148 INFO:teuthology.orchestra.run.smithi143.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-11T14:36:07.932 INFO:teuthology.orchestra.run.smithi143.stdout:(8/9): ceph-test-19.3.0-4872.g0d61375b.el9.x86_ 29 MB/s | 85 MB 00:02 2024-09-11T14:36:08.282 INFO:teuthology.orchestra.run.smithi143.stdout:(9/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 48 kB/s | 64 kB 00:01 2024-09-11T14:36:08.286 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:36:08.286 INFO:teuthology.orchestra.run.smithi143.stdout:Total 21 MB/s | 87 MB 00:04 2024-09-11T14:36:08.370 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:36:08.393 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:36:08.393 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:36:08.994 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:36:08.994 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:36:09.888 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:36:09.957 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:36:10.010 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:36:10.054 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:36:10.087 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:36:10.128 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:36:10.152 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:36:10.223 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:36:10.270 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:36:10.296 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:36:13.658 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-11T14:36:13.659 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:14.808 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:36:14.837 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 33/35 2024-09-11T14:36:14.837 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:14.837 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:36:14.837 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:36:14.837 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:36:14.838 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:14.840 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:36:14.927 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:36:14.927 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:36:16.327 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 1/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 3/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 4/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 5/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_6 6/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 7/35 2024-09-11T14:36:16.328 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9. 8/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x8 9/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 10/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 11/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 12/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 13/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:36:16.329 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:36:16.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:36:16.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 32/35 2024-09-11T14:36:16.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:36:16.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 34/35 2024-09-11T14:36:17.292 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:36:17.292 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:17.292 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:36:17.293 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.294 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:17.295 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:36:17.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-test 2024-09-11T14:36:18.263 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:30 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:36:18.410 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:36:18.411 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:36:18.411 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:36:18.411 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 85 M 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 175 k 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:36:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout:Install 9 Packages 2024-09-11T14:36:18.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:18.414 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 87 M 2024-09-11T14:36:18.414 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 797 M 2024-09-11T14:36:18.414 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:36:19.140 INFO:teuthology.orchestra.run.smithi052.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 601 kB/s | 94 kB 00:00 2024-09-11T14:36:19.232 INFO:teuthology.orchestra.run.smithi052.stdout:(2/9): libcephsqlite-19.3.0-4872.g0d61375b.el9. 703 kB/s | 175 kB 00:00 2024-09-11T14:36:19.398 INFO:teuthology.orchestra.run.smithi052.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 1.9 MB/s | 513 kB 00:00 2024-09-11T14:36:19.424 INFO:teuthology.orchestra.run.smithi052.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 953 kB/s | 183 kB 00:00 2024-09-11T14:36:19.524 INFO:teuthology.orchestra.run.smithi052.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-11T14:36:19.549 INFO:teuthology.orchestra.run.smithi052.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-11T14:36:19.591 INFO:teuthology.orchestra.run.smithi052.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-11T14:36:19.616 INFO:teuthology.orchestra.run.smithi052.stdout:(8/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 694 kB/s | 64 kB 00:00 2024-09-11T14:36:21.556 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:36:21.644 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:36:21.666 INFO:teuthology.orchestra.run.smithi052.stdout:(9/9): ceph-test-19.3.0-4872.g0d61375b.el9.x86_ 32 MB/s | 85 MB 00:02 2024-09-11T14:36:21.670 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:36:21.670 INFO:teuthology.orchestra.run.smithi052.stdout:Total 27 MB/s | 87 MB 00:03 2024-09-11T14:36:21.757 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:36:21.782 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:36:21.782 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:36:22.414 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:36:22.414 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:36:23.331 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:36:23.406 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:36:23.456 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:36:23.505 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:36:23.537 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:36:23.571 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:36:23.595 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:36:23.674 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:36:23.721 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:36:23.746 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 1/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:36:27.829 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:36:28.195 INFO:teuthology.orchestra.run.smithi143.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:36:28.196 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:36:28.196 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:36:28.196 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:36:28.196 INFO:teuthology.orchestra.run.smithi143.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:36:28.196 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:28.196 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:36:28.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph 2024-09-11T14:36:29.102 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:36:29.242 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:36:29.244 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:29.244 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.5 k 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 2.2 M 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 1.6 M 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 291 k 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.1 M 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 71 M 2024-09-11T14:36:29.245 INFO:teuthology.orchestra.run.smithi143.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:36:29.246 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:36:29.247 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout:Install 37 Packages 2024-09-11T14:36:29.248 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:29.249 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 84 M 2024-09-11T14:36:29.249 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 896 M 2024-09-11T14:36:29.249 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:36:29.747 INFO:teuthology.orchestra.run.smithi143.stdout:(1/37): ceph-19.3.0-4872.g0d61375b.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-11T14:36:30.089 INFO:teuthology.orchestra.run.smithi143.stdout:(2/37): ceph-mgr-19.3.0-4872.g0d61375b.el9.x86_ 2.7 MB/s | 1.6 MB 00:00 2024-09-11T14:36:30.131 INFO:teuthology.orchestra.run.smithi143.stdout:(3/37): ceph-mds-19.3.0-4872.g0d61375b.el9.x86_ 3.4 MB/s | 2.2 MB 00:00 2024-09-11T14:36:30.214 INFO:teuthology.orchestra.run.smithi143.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4872.g0d61 3.4 MB/s | 291 kB 00:00 2024-09-11T14:36:30.414 INFO:teuthology.orchestra.run.smithi143.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-11T14:36:30.573 INFO:teuthology.orchestra.run.smithi143.stdout:(6/37): ceph-mon-19.3.0-4872.g0d61375b.el9.x86_ 6.2 MB/s | 5.1 MB 00:00 2024-09-11T14:36:30.615 INFO:teuthology.orchestra.run.smithi143.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 6.1 MB/s | 1.2 MB 00:00 2024-09-11T14:36:30.724 INFO:teuthology.orchestra.run.smithi143.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-09-11T14:36:30.757 INFO:teuthology.orchestra.run.smithi143.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-11T14:36:30.807 INFO:teuthology.orchestra.run.smithi143.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-09-11T14:36:30.841 INFO:teuthology.orchestra.run.smithi143.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-11T14:36:31.358 INFO:teuthology.orchestra.run.smithi143.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 342 kB/s | 188 kB 00:00 2024-09-11T14:36:31.392 INFO:teuthology.orchestra.run.smithi143.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 313 kB/s | 172 kB 00:00 2024-09-11T14:36:31.467 INFO:teuthology.orchestra.run.smithi143.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-11T14:36:31.500 INFO:teuthology.orchestra.run.smithi143.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 711 kB/s | 77 kB 00:00 2024-09-11T14:36:31.584 INFO:teuthology.orchestra.run.smithi143.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-11T14:36:31.609 INFO:teuthology.orchestra.run.smithi143.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-11T14:36:31.651 INFO:teuthology.orchestra.run.smithi143.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-11T14:36:31.677 INFO:teuthology.orchestra.run.smithi143.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-11T14:36:31.702 INFO:teuthology.orchestra.run.smithi143.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-11T14:36:31.736 INFO:teuthology.orchestra.run.smithi143.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T14:36:32.328 INFO:teuthology.orchestra.run.smithi143.stdout:(22/37): ceph-osd-19.3.0-4872.g0d61375b.el9.x86 31 MB/s | 71 MB 00:02 2024-09-11T14:36:32.353 INFO:teuthology.orchestra.run.smithi143.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 17 kB/s | 11 kB 00:00 2024-09-11T14:36:32.387 INFO:teuthology.orchestra.run.smithi143.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 903 kB/s | 23 kB 00:00 2024-09-11T14:36:32.412 INFO:teuthology.orchestra.run.smithi143.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 845 kB/s | 19 kB 00:00 2024-09-11T14:36:32.437 INFO:teuthology.orchestra.run.smithi143.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-09-11T14:36:32.471 INFO:teuthology.orchestra.run.smithi143.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 335 kB/s | 20 kB 00:00 2024-09-11T14:36:32.496 INFO:teuthology.orchestra.run.smithi143.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 789 kB/s | 46 kB 00:00 2024-09-11T14:36:32.530 INFO:teuthology.orchestra.run.smithi143.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 433 kB/s | 358 kB 00:00 2024-09-11T14:36:32.555 INFO:teuthology.orchestra.run.smithi143.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 939 kB/s | 79 kB 00:00 2024-09-11T14:36:32.580 INFO:teuthology.orchestra.run.smithi143.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-11T14:36:32.606 INFO:teuthology.orchestra.run.smithi143.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-11T14:36:32.623 INFO:teuthology.orchestra.run.smithi143.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-11T14:36:32.648 INFO:teuthology.orchestra.run.smithi143.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-11T14:36:32.681 INFO:teuthology.orchestra.run.smithi143.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-11T14:36:32.707 INFO:teuthology.orchestra.run.smithi143.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 341 kB/s | 20 kB 00:00 2024-09-11T14:36:32.740 INFO:teuthology.orchestra.run.smithi143.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-11T14:36:32.745 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:36:32.745 INFO:teuthology.orchestra.run.smithi143.stdout:Total 24 MB/s | 84 MB 00:03 2024-09-11T14:36:32.893 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:36:32.934 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:36:32.934 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:36:33.726 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:36:33.726 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:36:35.401 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:36:35.459 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:36:35.492 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:36:35.520 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:36:35.596 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:36:35.639 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:36:35.658 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 8/9 2024-09-11T14:36:35.672 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:36:35.757 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:36:35.764 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:36:35.843 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:36:35.883 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:36:35.918 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:36:35.948 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:36:35.983 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:36:36.017 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:36:36.064 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:36:36.100 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:36:36.134 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:36:36.183 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:36:36.215 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:36:36.288 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:36:36.435 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:36:36.515 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:36:36.568 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:36:36.606 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:36:36.656 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:36:36.711 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:36:36.906 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:36:36.952 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:36:37.022 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:36:37.114 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:36:37.155 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:36:37.285 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:36:37.484 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 32/37 2024-09-11T14:36:37.516 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:36:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:36:37.541 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:37.541 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:36:37.541 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:36:37.541 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:36:37.541 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:41.863 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 9/9 2024-09-11T14:36:41.863 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 1/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:36:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:36:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:36:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:42.281 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:36:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:42.282 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:36:42.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph 2024-09-11T14:36:43.197 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:36:43.339 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 6.5 k 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 2.2 M 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 1.6 M 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 291 k 2024-09-11T14:36:43.342 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 5.1 M 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 71 M 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections 2024-09-11T14:36:43.343 INFO:teuthology.orchestra.run.smithi052.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:36:43.344 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout:Install 37 Packages 2024-09-11T14:36:43.345 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:43.346 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 84 M 2024-09-11T14:36:43.346 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 896 M 2024-09-11T14:36:43.346 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:36:44.037 INFO:teuthology.orchestra.run.smithi052.stdout:(1/37): ceph-19.3.0-4872.g0d61375b.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-11T14:36:44.212 INFO:teuthology.orchestra.run.smithi052.stdout:(2/37): ceph-mgr-19.3.0-4872.g0d61375b.el9.x86_ 4.9 MB/s | 1.6 MB 00:00 2024-09-11T14:36:44.262 INFO:teuthology.orchestra.run.smithi052.stdout:(3/37): ceph-mds-19.3.0-4872.g0d61375b.el9.x86_ 5.9 MB/s | 2.2 MB 00:00 2024-09-11T14:36:44.346 INFO:teuthology.orchestra.run.smithi052.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4872.g0d61 3.4 MB/s | 291 kB 00:00 2024-09-11T14:36:44.546 INFO:teuthology.orchestra.run.smithi052.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-11T14:36:44.713 INFO:teuthology.orchestra.run.smithi052.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 7.4 MB/s | 1.2 MB 00:00 2024-09-11T14:36:44.788 INFO:teuthology.orchestra.run.smithi052.stdout:(7/37): ceph-mon-19.3.0-4872.g0d61375b.el9.x86_ 6.8 MB/s | 5.1 MB 00:00 2024-09-11T14:36:44.813 INFO:teuthology.orchestra.run.smithi052.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-11T14:36:44.872 INFO:teuthology.orchestra.run.smithi052.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-11T14:36:44.931 INFO:teuthology.orchestra.run.smithi052.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-11T14:36:44.989 INFO:teuthology.orchestra.run.smithi052.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 674 kB/s | 135 kB 00:00 2024-09-11T14:36:45.056 INFO:teuthology.orchestra.run.smithi052.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-11T14:36:45.115 INFO:teuthology.orchestra.run.smithi052.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-11T14:36:45.150 INFO:teuthology.orchestra.run.smithi052.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 370 kB/s | 35 kB 00:00 2024-09-11T14:36:45.190 INFO:teuthology.orchestra.run.smithi052.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-11T14:36:45.216 INFO:teuthology.orchestra.run.smithi052.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 780 kB/s | 51 kB 00:00 2024-09-11T14:36:45.274 INFO:teuthology.orchestra.run.smithi052.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-11T14:36:45.308 INFO:teuthology.orchestra.run.smithi052.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-11T14:36:45.342 INFO:teuthology.orchestra.run.smithi052.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T14:36:45.375 INFO:teuthology.orchestra.run.smithi052.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 668 kB/s | 43 kB 00:00 2024-09-11T14:36:45.400 INFO:teuthology.orchestra.run.smithi052.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-09-11T14:36:45.426 INFO:teuthology.orchestra.run.smithi052.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 433 kB/s | 11 kB 00:00 2024-09-11T14:36:45.451 INFO:teuthology.orchestra.run.smithi052.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 707 kB/s | 18 kB 00:00 2024-09-11T14:36:45.476 INFO:teuthology.orchestra.run.smithi052.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 933 kB/s | 23 kB 00:00 2024-09-11T14:36:45.502 INFO:teuthology.orchestra.run.smithi052.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 782 kB/s | 19 kB 00:00 2024-09-11T14:36:45.527 INFO:teuthology.orchestra.run.smithi052.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 788 kB/s | 20 kB 00:00 2024-09-11T14:36:45.552 INFO:teuthology.orchestra.run.smithi052.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-11T14:36:45.578 INFO:teuthology.orchestra.run.smithi052.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-11T14:36:45.603 INFO:teuthology.orchestra.run.smithi052.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:36:45.636 INFO:teuthology.orchestra.run.smithi052.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 494 kB/s | 16 kB 00:00 2024-09-11T14:36:45.662 INFO:teuthology.orchestra.run.smithi052.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-11T14:36:45.686 INFO:teuthology.orchestra.run.smithi052.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-11T14:36:45.712 INFO:teuthology.orchestra.run.smithi052.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-11T14:36:45.737 INFO:teuthology.orchestra.run.smithi052.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T14:36:45.771 INFO:teuthology.orchestra.run.smithi052.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 602 kB/s | 20 kB 00:00 2024-09-11T14:36:45.796 INFO:teuthology.orchestra.run.smithi052.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-11T14:36:46.971 INFO:teuthology.orchestra.run.smithi052.stdout:(37/37): ceph-osd-19.3.0-4872.g0d61375b.el9.x86 26 MB/s | 71 MB 00:02 2024-09-11T14:36:46.975 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:36:46.976 INFO:teuthology.orchestra.run.smithi052.stdout:Total 23 MB/s | 84 MB 00:03 2024-09-11T14:36:47.156 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:36:47.202 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:36:47.202 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:36:48.058 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:36:48.080 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:36:48.080 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:36:48.085 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:36:48.085 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:48.085 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:36:48.085 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:36:48.085 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:36:48.085 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:48.625 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:36:48.649 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:36:48.649 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:48.649 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:36:48.649 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:36:48.649 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:36:48.649 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:48.884 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:36:48.908 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:36:48.908 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:48.908 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:36:48.908 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:36:48.908 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:36:48.908 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:48.972 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:36:49.775 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:36:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:36:49.874 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:36:49.901 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:36:49.976 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:36:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:36:50.078 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:36:50.174 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:36:50.251 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:36:50.298 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:36:50.332 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:36:50.370 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:36:50.404 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:36:50.438 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:36:50.479 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:36:50.522 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:36:50.556 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:36:50.606 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:36:50.653 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:36:50.729 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:36:50.881 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:36:50.965 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:36:51.015 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:36:51.053 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:36:51.110 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:36:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:36:51.380 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:36:51.423 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:36:51.503 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:36:51.594 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:36:51.637 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:36:51.774 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:36:51.975 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 32/37 2024-09-11T14:36:52.005 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:36:52.032 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 33/37 2024-09-11T14:36:52.032 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:36:52.032 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:36:52.032 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:36:52.032 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:36:52.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:36:55.911 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 1/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 3/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 4/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 5/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 6/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:36:55.912 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:36:55.913 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:36:55.914 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:36:56.897 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:36:56.898 INFO:teuthology.orchestra.run.smithi143.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:36:56.899 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:36:56.900 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:56.901 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:36:57.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-base 2024-09-11T14:36:57.743 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:23 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:36:57.833 INFO:teuthology.orchestra.run.smithi143.stdout:Package ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:36:57.875 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:36:57.876 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:36:57.877 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:36:57.961 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install cephadm 2024-09-11T14:36:58.517 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:24 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:36:58.648 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 784 k 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:36:58.649 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:36:58.650 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 784 k 2024-09-11T14:36:58.650 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 791 k 2024-09-11T14:36:58.650 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:36:58.901 INFO:teuthology.orchestra.run.smithi143.stdout:cephadm-19.3.0-4872.g0d61375b.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-11T14:36:58.902 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:36:58.902 INFO:teuthology.orchestra.run.smithi143.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-11T14:36:58.902 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:36:58.907 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:36:58.907 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:36:58.913 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:36:58.914 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:36:58.984 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:36:59.463 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:36:59.556 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:36:59.929 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:00.163 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:00.163 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:00.164 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:00.164 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:00.164 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:00.164 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:00.391 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:37:00.971 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:01.105 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:01.106 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:01.106 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 158 k 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:01.107 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:01.108 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 158 k 2024-09-11T14:37:01.108 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 644 k 2024-09-11T14:37:01.108 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:01.300 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-immutable-object-cache-19.3.0-4872.g0d6137 819 kB/s | 158 kB 00:00 2024-09-11T14:37:01.301 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:01.301 INFO:teuthology.orchestra.run.smithi143.stdout:Total 812 kB/s | 158 kB 00:00 2024-09-11T14:37:01.301 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:01.311 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:01.311 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:01.368 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:01.369 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:01.523 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:01.601 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:37:01.627 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:37:01.627 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:01.627 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:37:01.627 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:02.583 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:37:02.583 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:02.583 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:02.583 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:02.583 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:02.584 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:02.810 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr 2024-09-11T14:37:03.205 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:37:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 34/37 2024-09-11T14:37:03.233 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:03.233 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:37:03.234 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:37:03.234 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:37:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:03.383 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:03.475 INFO:teuthology.orchestra.run.smithi143.stdout:Package ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:03.517 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:03.518 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:03.518 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:03.600 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:37:03.814 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:37:03.839 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 35/37 2024-09-11T14:37:03.839 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:03.839 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:37:03.839 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:37:03.839 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:37:03.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:04.089 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:37:04.115 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 36/37 2024-09-11T14:37:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:37:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:37:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:37:04.115 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:04.160 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:30 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:04.181 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:37:04.292 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:04.293 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 14 M 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 34 k 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 16 k 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:37:04.294 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout:Install 11 Packages 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:04.295 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 18 M 2024-09-11T14:37:04.296 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 155 M 2024-09-11T14:37:04.296 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:05.088 INFO:teuthology.orchestra.run.smithi143.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4872.g0d6 99 kB/s | 16 kB 00:00 2024-09-11T14:37:05.113 INFO:teuthology.orchestra.run.smithi143.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4872.g0d 179 kB/s | 34 kB 00:00 2024-09-11T14:37:05.288 INFO:teuthology.orchestra.run.smithi143.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-09-11T14:37:05.339 INFO:teuthology.orchestra.run.smithi143.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:37:05.364 INFO:teuthology.orchestra.run.smithi143.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-11T14:37:05.439 INFO:teuthology.orchestra.run.smithi143.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-11T14:37:05.465 INFO:teuthology.orchestra.run.smithi143.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-11T14:37:05.490 INFO:teuthology.orchestra.run.smithi143.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T14:37:05.515 INFO:teuthology.orchestra.run.smithi143.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-11T14:37:05.674 INFO:teuthology.orchestra.run.smithi143.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4872.g0d6137 19 MB/s | 14 MB 00:00 2024-09-11T14:37:05.966 INFO:teuthology.orchestra.run.smithi143.stdout:(11/11): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-11T14:37:05.969 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:05.969 INFO:teuthology.orchestra.run.smithi143.stdout:Total 11 MB/s | 18 MB 00:01 2024-09-11T14:37:06.002 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:06.022 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:06.022 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:06.303 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:06.303 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:06.846 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:06.922 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:37:06.961 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:37:07.097 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:37:07.221 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:37:07.281 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:37:07.365 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:37:07.417 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:37:07.445 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:37:07.539 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 9/11 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 37/37 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 1/37 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2/37 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 3/37 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 4/37 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 5/37 2024-09-11T14:37:10.675 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9. 6/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:37:10.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:37:10.677 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:37:10.678 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:37:10.678 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:37:10.679 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:37:10.722 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 10/11 2024-09-11T14:37:10.774 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:11.839 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:37:11.840 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:37:11.841 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:37:11.842 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:37:11.842 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:37:11.842 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:37:11.842 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:37:11.842 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:11.842 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:12.085 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base 2024-09-11T14:37:12.674 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:24 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:12.675 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:37:12.675 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 1/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 2/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 3/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:37:12.676 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:37:12.766 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-base-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:12.811 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:12.812 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:37:12.812 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:12.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install cephadm 2024-09-11T14:37:12.995 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:37:12.995 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:12.995 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:12.995 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:37:12.995 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:12.996 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:13.260 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:37:13.475 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:25 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:13.616 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:13.617 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:13.617 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:13.617 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:13.617 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:13.617 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 784 k 2024-09-11T14:37:13.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 784 k 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 791 k 2024-09-11T14:37:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:13.825 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:13.897 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm-19.3.0-4872.g0d61375b.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-11T14:37:13.897 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:13.898 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-11T14:37:13.898 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:13.904 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:13.904 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:13.910 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:13.910 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:13.960 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:13.961 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-09-11T14:37:13.961 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:37:13.961 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-09-11T14:37:13.961 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 7.4 M 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:37:13.962 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout:Install 12 Packages 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 38 M 2024-09-11T14:37:13.963 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 212 M 2024-09-11T14:37:13.964 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:14.181 INFO:teuthology.orchestra.run.smithi143.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-11T14:37:14.223 INFO:teuthology.orchestra.run.smithi143.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-11T14:37:14.249 INFO:teuthology.orchestra.run.smithi143.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-11T14:37:14.291 INFO:teuthology.orchestra.run.smithi143.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-11T14:37:14.358 INFO:teuthology.orchestra.run.smithi143.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-09-11T14:37:14.377 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:14.383 INFO:teuthology.orchestra.run.smithi143.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-11T14:37:14.462 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:14.475 INFO:teuthology.orchestra.run.smithi143.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 42 MB/s | 4.9 MB 00:00 2024-09-11T14:37:14.509 INFO:teuthology.orchestra.run.smithi143.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-11T14:37:14.609 INFO:teuthology.orchestra.run.smithi143.stdout:(9/12): ceph-mgr-diskprediction-local-19.3.0-48 13 MB/s | 7.4 MB 00:00 2024-09-11T14:37:14.634 INFO:teuthology.orchestra.run.smithi143.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.0 MB/s | 250 kB 00:00 2024-09-11T14:37:14.710 INFO:teuthology.orchestra.run.smithi143.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-11T14:37:14.841 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:15.060 INFO:teuthology.orchestra.run.smithi143.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-11T14:37:15.060 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:15.061 INFO:teuthology.orchestra.run.smithi143.stdout:Total 35 MB/s | 38 MB 00:01 2024-09-11T14:37:15.096 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:15.096 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:15.096 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:15.096 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:15.096 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:15.096 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:15.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:37:15.416 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:15.441 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:15.441 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:15.880 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:15.881 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:15.920 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:27 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:16.058 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:16.059 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:16.059 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-11T14:37:16.059 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:16.059 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:16.059 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 158 k 2024-09-11T14:37:16.059 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 158 k 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 644 k 2024-09-11T14:37:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:16.471 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-immutable-object-cache-19.3.0-4872.g0d6137 385 kB/s | 158 kB 00:00 2024-09-11T14:37:16.471 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:16.471 INFO:teuthology.orchestra.run.smithi052.stdout:Total 383 kB/s | 158 kB 00:00 2024-09-11T14:37:16.472 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:16.483 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:16.483 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:16.545 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:16.546 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:16.653 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:16.703 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:16.714 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:37:16.763 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:37:16.766 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:37:16.790 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:37:16.790 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:16.790 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:37:16.790 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:16.864 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:37:16.901 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:37:17.093 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:37:17.125 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:37:17.201 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:37:17.740 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b. 1/1 2024-09-11T14:37:17.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:17.740 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:17.740 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:17.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:17.740 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:17.846 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:37:17.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr 2024-09-11T14:37:17.981 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:37:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:30 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-mgr-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:37:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:18.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:37:19.262 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:37:19.353 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:19.491 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 14 M 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 34 k 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 16 k 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:37:19.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout:Install 11 Packages 2024-09-11T14:37:19.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:19.495 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 18 M 2024-09-11T14:37:19.495 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 155 M 2024-09-11T14:37:19.495 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:20.215 INFO:teuthology.orchestra.run.smithi052.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4872.g0d6 110 kB/s | 16 kB 00:00 2024-09-11T14:37:20.240 INFO:teuthology.orchestra.run.smithi052.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4872.g0d 196 kB/s | 34 kB 00:00 2024-09-11T14:37:20.283 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:37:20.309 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:37:20.390 INFO:teuthology.orchestra.run.smithi052.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-09-11T14:37:20.441 INFO:teuthology.orchestra.run.smithi052.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:37:20.466 INFO:teuthology.orchestra.run.smithi052.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-11T14:37:20.558 INFO:teuthology.orchestra.run.smithi052.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 22 MB/s | 2.0 MB 00:00 2024-09-11T14:37:20.600 INFO:teuthology.orchestra.run.smithi052.stdout:(7/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.3 MB/s | 863 kB 00:00 2024-09-11T14:37:20.617 INFO:teuthology.orchestra.run.smithi052.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-11T14:37:20.634 INFO:teuthology.orchestra.run.smithi052.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 922 kB/s | 31 kB 00:00 2024-09-11T14:37:20.676 INFO:teuthology.orchestra.run.smithi052.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T14:37:20.826 INFO:teuthology.orchestra.run.smithi052.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4872.g0d6137 19 MB/s | 14 MB 00:00 2024-09-11T14:37:20.830 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:20.830 INFO:teuthology.orchestra.run.smithi052.stdout:Total 14 MB/s | 18 MB 00:01 2024-09-11T14:37:20.863 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:20.883 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:20.884 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:21.174 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:21.174 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:21.865 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:21.959 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:37:21.988 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:37:22.094 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:37:22.226 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:37:22.283 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:37:22.369 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:37:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:37:22.588 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:37:22.620 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 9/11 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 1/12 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:37:23.006 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:37:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:37:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:37:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:37:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:37:23.007 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:37:23.400 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:37:23.400 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:37:23.401 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:37:23.402 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:37:23.402 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:23.402 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:23.813 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:37:24.384 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:50 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:24.519 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 49 k 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:37:24.520 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout:Install 13 Packages 2024-09-11T14:37:24.521 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:24.522 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 2.2 M 2024-09-11T14:37:24.522 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 26 M 2024-09-11T14:37:24.522 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:24.721 INFO:teuthology.orchestra.run.smithi143.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 203 kB/s | 19 kB 00:00 2024-09-11T14:37:24.746 INFO:teuthology.orchestra.run.smithi143.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 214 kB/s | 26 kB 00:00 2024-09-11T14:37:24.805 INFO:teuthology.orchestra.run.smithi143.stdout:(3/13): ceph-mgr-rook-19.3.0-4872.g0d61375b.el9 277 kB/s | 49 kB 00:00 2024-09-11T14:37:24.830 INFO:teuthology.orchestra.run.smithi143.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-11T14:37:24.864 INFO:teuthology.orchestra.run.smithi143.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-11T14:37:24.897 INFO:teuthology.orchestra.run.smithi143.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 801 kB/s | 54 kB 00:00 2024-09-11T14:37:24.931 INFO:teuthology.orchestra.run.smithi143.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-11T14:37:24.956 INFO:teuthology.orchestra.run.smithi143.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-09-11T14:37:24.981 INFO:teuthology.orchestra.run.smithi143.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 171 kB/s | 14 kB 00:00 2024-09-11T14:37:25.015 INFO:teuthology.orchestra.run.smithi143.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-11T14:37:25.040 INFO:teuthology.orchestra.run.smithi143.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-11T14:37:25.065 INFO:teuthology.orchestra.run.smithi143.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 704 kB/s | 59 kB 00:00 2024-09-11T14:37:25.099 INFO:teuthology.orchestra.run.smithi143.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-11T14:37:25.101 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:25.102 INFO:teuthology.orchestra.run.smithi143.stdout:Total 3.8 MB/s | 2.2 MB 00:00 2024-09-11T14:37:25.163 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:25.179 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:25.179 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:25.268 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:25.268 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:25.775 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:25.944 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:37:25.997 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 10/11 2024-09-11T14:37:26.008 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:37:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:37:26.072 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:37:26.118 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:37:26.159 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:37:26.260 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:37:26.362 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:37:26.412 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:37:27.128 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:37:27.184 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:37:27.218 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:37:27.266 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:37:27.288 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:37:28.006 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 11/11 2024-09-11T14:37:28.006 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el 1/11 2024-09-11T14:37:28.006 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noa 2/11 2024-09-11T14:37:28.006 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9 3/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:37:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:37:28.023 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:37:28.023 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 1/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:37:28.024 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:37:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:37:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:28.336 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:37:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:28.337 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:37:28.362 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:28.363 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:28.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:37:28.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:37:29.176 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:29.222 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:01:55 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:29.317 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 7.4 M 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:37:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:Install 12 Packages 2024-09-11T14:37:29.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:29.320 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 38 M 2024-09-11T14:37:29.320 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 212 M 2024-09-11T14:37:29.320 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:29.356 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 154 k 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:37:29.357 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout:Install 6 Packages 2024-09-11T14:37:29.358 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:29.359 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 7.0 M 2024-09-11T14:37:29.359 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 33 M 2024-09-11T14:37:29.359 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:29.856 INFO:teuthology.orchestra.run.smithi052.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 906 kB/s | 191 kB 00:00 2024-09-11T14:37:29.956 INFO:teuthology.orchestra.run.smithi052.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-11T14:37:29.986 INFO:teuthology.orchestra.run.smithi143.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4872.g0d61375b.e 707 kB/s | 154 kB 00:00 2024-09-11T14:37:30.036 INFO:teuthology.orchestra.run.smithi143.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:37:30.061 INFO:teuthology.orchestra.run.smithi143.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-11T14:37:30.086 INFO:teuthology.orchestra.run.smithi143.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-11T14:37:30.100 INFO:teuthology.orchestra.run.smithi052.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-11T14:37:30.403 INFO:teuthology.orchestra.run.smithi143.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 390 kB/s | 248 kB 00:00 2024-09-11T14:37:30.540 INFO:teuthology.orchestra.run.smithi052.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 48 kB/s | 33 kB 00:00 2024-09-11T14:37:30.631 INFO:teuthology.orchestra.run.smithi052.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 34 kB/s | 18 kB 00:00 2024-09-11T14:37:31.029 INFO:teuthology.orchestra.run.smithi143.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-11T14:37:31.030 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:31.031 INFO:teuthology.orchestra.run.smithi143.stdout:Total 4.2 MB/s | 7.0 MB 00:01 2024-09-11T14:37:31.102 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:31.113 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:31.113 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:31.182 INFO:teuthology.orchestra.run.smithi052.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-09-11T14:37:31.198 INFO:teuthology.orchestra.run.smithi052.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 58 kB/s | 38 kB 00:00 2024-09-11T14:37:31.211 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:31.211 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:31.514 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:31.693 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:37:31.747 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:37:31.857 INFO:teuthology.orchestra.run.smithi052.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.0 MB/s | 4.9 MB 00:01 2024-09-11T14:37:32.024 INFO:teuthology.orchestra.run.smithi052.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-09-11T14:37:32.264 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:37:32.358 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:37:32.441 INFO:teuthology.orchestra.run.smithi052.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-11T14:37:32.451 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:37:32.476 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:37:32.766 INFO:teuthology.orchestra.run.smithi052.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 276 kB/s | 250 kB 00:00 2024-09-11T14:37:33.239 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:37:33.239 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/6 2024-09-11T14:37:33.239 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:37:33.239 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:37:33.240 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:37:33.240 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:37:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:37:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:33.510 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:37:33.510 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:37:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:37:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:37:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:37:33.511 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:33.511 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:33.600 INFO:teuthology.orchestra.run.smithi052.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-11T14:37:33.601 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:33.601 INFO:teuthology.orchestra.run.smithi052.stdout:Total 8.9 MB/s | 38 MB 00:04 2024-09-11T14:37:33.809 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-fuse 2024-09-11T14:37:33.976 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:34.003 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:34.003 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:34.367 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:00 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:34.477 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:34.478 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:34.501 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:34.501 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:34.501 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:37:34.501 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:34.501 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 884 k 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout:Install 2 Packages 2024-09-11T14:37:34.502 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:34.503 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 964 k 2024-09-11T14:37:34.503 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 4.1 M 2024-09-11T14:37:34.503 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:34.665 INFO:teuthology.orchestra.run.smithi143.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 567 kB/s | 80 kB 00:00 2024-09-11T14:37:35.148 INFO:teuthology.orchestra.run.smithi143.stdout:(2/2): ceph-fuse-19.3.0-4872.g0d61375b.el9.x86_ 1.4 MB/s | 884 kB 00:00 2024-09-11T14:37:35.149 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:35.149 INFO:teuthology.orchestra.run.smithi143.stdout:Total 1.5 MB/s | 964 kB 00:00 2024-09-11T14:37:35.161 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:35.185 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:35.185 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:35.266 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:35.266 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:35.269 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:37:35.382 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:37:35.457 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:35.487 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:37:35.525 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:37:35.609 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:37:35.672 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:37:35.715 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:37:35.739 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:37:35.851 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:37:36.374 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:37:36.374 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/2 2024-09-11T14:37:36.560 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:37:36.648 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:37:36.648 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:36.648 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:36.649 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:37:36.649 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:36.649 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:36.682 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:37:36.978 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-volume 2024-09-11T14:37:37.563 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:03 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:37.697 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 285 k 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:37.698 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 285 k 2024-09-11T14:37:37.699 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 1.3 M 2024-09-11T14:37:37.699 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:37.937 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-volume-19.3.0-4872.g0d61375b.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-11T14:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T14:37:37.938 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:37.947 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:37.980 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:38.016 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:37:38.201 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:38.256 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:38.272 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:38.272 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:38.273 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:37:38.273 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:39.104 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:37:39.138 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:37:39.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:39.284 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:39.284 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:39.284 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:39.284 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:39.284 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:39.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install librados-devel 2024-09-11T14:37:40.207 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:06 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:40.348 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:40.348 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:40.348 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-11T14:37:40.348 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:40.348 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:40.348 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 125 k 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 125 k 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 445 k 2024-09-11T14:37:40.349 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:40.543 INFO:teuthology.orchestra.run.smithi143.stdout:librados-devel-19.3.0-4872.g0d61375b.el9.x86_64 642 kB/s | 125 kB 00:00 2024-09-11T14:37:40.544 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:40.544 INFO:teuthology.orchestra.run.smithi143.stdout:Total 637 kB/s | 125 kB 00:00 2024-09-11T14:37:40.544 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:40.550 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:40.550 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:40.614 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:40.614 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:40.766 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:40.858 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:41.303 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:41.569 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:41.570 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:41.660 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 12/12 2024-09-11T14:37:41.660 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d613 1/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:37:41.661 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:37:41.830 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install libcephfs2 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:37:42.187 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:37:42.188 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:37:42.188 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:37:42.188 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:37:42.188 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:37:42.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:42.188 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:42.409 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:08 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:42.502 INFO:teuthology.orchestra.run.smithi143.stdout:Package libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:42.547 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:42.549 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:42.549 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:42.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:37:42.625 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install libcephfs-devel 2024-09-11T14:37:43.153 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:55 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:43.194 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:09 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:43.294 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:43.295 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:43.295 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 49 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:37:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:43.297 INFO:teuthology.orchestra.run.smithi052.stdout:Install 13 Packages 2024-09-11T14:37:43.298 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:43.298 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 2.2 M 2024-09-11T14:37:43.298 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 26 M 2024-09-11T14:37:43.298 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:43.329 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:43.329 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:43.329 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-11T14:37:43.329 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:43.329 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:43.329 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 32 k 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 32 k 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 142 k 2024-09-11T14:37:43.330 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:43.481 INFO:teuthology.orchestra.run.smithi143.stdout:libcephfs-devel-19.3.0-4872.g0d61375b.el9.x86_6 211 kB/s | 32 kB 00:00 2024-09-11T14:37:43.482 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:43.482 INFO:teuthology.orchestra.run.smithi143.stdout:Total 209 kB/s | 32 kB 00:00 2024-09-11T14:37:43.482 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:43.485 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:43.485 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:43.506 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:43.507 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:43.596 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:43.704 INFO:teuthology.orchestra.run.smithi052.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 211 kB/s | 19 kB 00:00 2024-09-11T14:37:43.711 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:43.729 INFO:teuthology.orchestra.run.smithi052.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 221 kB/s | 26 kB 00:00 2024-09-11T14:37:43.788 INFO:teuthology.orchestra.run.smithi052.stdout:(3/13): ceph-mgr-rook-19.3.0-4872.g0d61375b.el9 282 kB/s | 49 kB 00:00 2024-09-11T14:37:43.980 INFO:teuthology.orchestra.run.smithi052.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 634 kB/s | 159 kB 00:00 2024-09-11T14:37:44.005 INFO:teuthology.orchestra.run.smithi052.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 739 kB/s | 222 kB 00:00 2024-09-11T14:37:44.039 INFO:teuthology.orchestra.run.smithi052.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-11T14:37:44.073 INFO:teuthology.orchestra.run.smithi052.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-11T14:37:44.085 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:44.098 INFO:teuthology.orchestra.run.smithi052.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 250 kB/s | 14 kB 00:00 2024-09-11T14:37:44.123 INFO:teuthology.orchestra.run.smithi052.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 833 kB/s | 279 kB 00:00 2024-09-11T14:37:44.148 INFO:teuthology.orchestra.run.smithi052.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-11T14:37:44.182 INFO:teuthology.orchestra.run.smithi052.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-11T14:37:44.224 INFO:teuthology.orchestra.run.smithi052.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-11T14:37:44.249 INFO:teuthology.orchestra.run.smithi052.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 470 kB/s | 59 kB 00:00 2024-09-11T14:37:44.252 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:44.252 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-11T14:37:44.314 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:44.314 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:44.315 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:44.315 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:44.315 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:44.315 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:44.326 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:44.343 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:44.343 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:44.442 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:44.444 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:44.513 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install librados2 2024-09-11T14:37:44.966 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:45.076 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:45.138 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:37:45.166 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:45.210 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:45.211 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:45.211 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:45.261 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:37:45.294 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install librbd1 2024-09-11T14:37:45.317 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:37:45.351 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:37:45.402 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:37:45.509 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:37:45.619 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:37:45.679 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:37:45.860 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:45.951 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:45.995 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:45.996 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:45.996 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:46.073 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-rados 2024-09-11T14:37:46.454 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:37:46.525 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:37:46.559 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:37:46.617 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:37:46.634 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:46.644 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:37:46.726 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:46.769 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:46.770 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:46.771 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:46.847 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-rgw 2024-09-11T14:37:47.384 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 13/13 2024-09-11T14:37:47.384 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 1/13 2024-09-11T14:37:47.384 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:37:47.384 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:37:47.385 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:37:47.407 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:13 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:47.497 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:47.541 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:47.542 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:47.542 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:47.627 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-cephfs 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:37:47.726 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:47.727 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:47.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:37:48.196 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:48.287 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:48.330 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:48.331 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:48.331 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:48.418 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install python3-rbd 2024-09-11T14:37:48.551 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:00 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:48.693 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:48.693 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 154 k 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:48.694 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:48.695 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:48.695 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2024-09-11T14:37:48.695 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:48.695 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 7.0 M 2024-09-11T14:37:48.695 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 33 M 2024-09-11T14:37:48.695 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:48.981 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:49.072 INFO:teuthology.orchestra.run.smithi143.stdout:Package python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:37:49.091 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-11T14:37:49.115 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:49.117 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-11T14:37:49.117 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:49.141 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:37:49.167 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-11T14:37:49.192 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-11T14:37:49.193 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install rbd-fuse 2024-09-11T14:37:49.359 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): ceph-mgr-cephadm-19.3.0-4872.g0d61375b.e 356 kB/s | 154 kB 00:00 2024-09-11T14:37:49.759 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:15 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:49.893 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 91 k 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:49.894 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:49.895 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 91 k 2024-09-11T14:37:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 321 k 2024-09-11T14:37:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:50.009 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2024-09-11T14:37:50.011 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:50.012 INFO:teuthology.orchestra.run.smithi052.stdout:Total 5.3 MB/s | 7.0 MB 00:01 2024-09-11T14:37:50.088 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:50.100 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:50.100 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:50.206 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:50.206 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:50.284 INFO:teuthology.orchestra.run.smithi143.stdout:rbd-fuse-19.3.0-4872.g0d61375b.el9.x86_64.rpm 234 kB/s | 91 kB 00:00 2024-09-11T14:37:50.285 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:50.285 INFO:teuthology.orchestra.run.smithi143.stdout:Total 233 kB/s | 91 kB 00:00 2024-09-11T14:37:50.285 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:50.293 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:50.293 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:50.357 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:50.357 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:50.502 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:50.537 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:50.598 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:50.715 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:37:50.779 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:37:50.945 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:51.234 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:51.235 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:51.235 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:51.235 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:51.345 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:37:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:37:51.509 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:37:51.548 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:37:51.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install rbd-mirror 2024-09-11T14:37:52.138 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:52.283 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:52.283 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:52.283 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repo Size 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 3.5 M 2024-09-11T14:37:52.284 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 30 M 2024-09-11T14:37:52.285 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 6/6 2024-09-11T14:37:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 1/6 2024-09-11T14:37:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:37:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:37:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:37:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:37:52.650 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:37:52.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:52.650 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:52.650 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:52.651 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:52.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-fuse 2024-09-11T14:37:52.931 INFO:teuthology.orchestra.run.smithi143.stdout:rbd-mirror-19.3.0-4872.g0d61375b.el9.x86_64.rpm 5.4 MB/s | 3.5 MB 00:00 2024-09-11T14:37:52.932 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:52.932 INFO:teuthology.orchestra.run.smithi143.stdout:Total 5.4 MB/s | 3.5 MB 00:00 2024-09-11T14:37:52.933 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:52.944 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:52.944 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:53.028 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:53.028 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:53.486 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:05 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:53.614 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:53.625 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:53.626 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:53.626 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:53.626 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:53.626 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:53.626 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 884 k 2024-09-11T14:37:53.626 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:53.627 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 964 k 2024-09-11T14:37:53.628 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 4.1 M 2024-09-11T14:37:53.628 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:53.690 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:53.717 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:53.717 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:53.717 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:37:53.717 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:37:53.717 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:37:53.717 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:53.794 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 693 kB/s | 80 kB 00:00 2024-09-11T14:37:53.961 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): ceph-fuse-19.3.0-4872.g0d61375b.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-11T14:37:53.961 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:53.961 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.8 MB/s | 964 kB 00:00 2024-09-11T14:37:53.974 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:53.999 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:53.999 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:54.085 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:54.085 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:54.288 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:54.443 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:37:54.513 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:37:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:54.950 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:54.950 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:55.205 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2/2 2024-09-11T14:37:55.205 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/2 2024-09-11T14:37:55.217 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install rbd-nbd 2024-09-11T14:37:55.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:37:55.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:55.500 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:55.500 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:37:55.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:55.500 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:55.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-volume 2024-09-11T14:37:55.798 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:35:34 PM UTC. 2024-09-11T14:37:55.931 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 177 k 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-11T14:37:55.932 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-09-11T14:37:55.933 INFO:teuthology.orchestra.run.smithi143.stdout:Install 1 Package 2024-09-11T14:37:55.933 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:55.933 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 177 k 2024-09-11T14:37:55.933 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 685 k 2024-09-11T14:37:55.933 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-11T14:37:56.152 INFO:teuthology.orchestra.run.smithi143.stdout:rbd-nbd-19.3.0-4872.g0d61375b.el9.x86_64.rpm 807 kB/s | 177 kB 00:00 2024-09-11T14:37:56.152 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:56.152 INFO:teuthology.orchestra.run.smithi143.stdout:Total 802 kB/s | 177 kB 00:00 2024-09-11T14:37:56.153 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-11T14:37:56.162 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-11T14:37:56.162 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-11T14:37:56.226 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-11T14:37:56.227 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-11T14:37:56.370 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:08 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:56.385 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-11T14:37:56.490 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:56.511 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.3.0-4872.g0d61375b.el9 ceph-noarch 285 k 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:56.512 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:56.513 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:37:56.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:56.513 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 285 k 2024-09-11T14:37:56.513 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 1.3 M 2024-09-11T14:37:56.513 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:56.739 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-volume-19.3.0-4872.g0d61375b.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-11T14:37:56.740 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:56.740 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T14:37:56.740 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:56.750 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:56.750 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:56.782 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:56.782 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:56.893 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:57.020 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:57.091 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:57.108 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:57.109 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:37:57.109 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:37:57.109 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:37:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:57.145 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-11T14:37:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:37:57.145 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:37:57.145 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-11T14:37:57.430 DEBUG:teuthology.parallel:result is None 2024-09-11T14:37:58.073 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 1/1 2024-09-11T14:37:58.073 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:58.074 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:37:58.074 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.3.0-4872.g0d61375b.el9.noarch 2024-09-11T14:37:58.074 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:58.074 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:37:58.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados-devel 2024-09-11T14:37:58.957 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:10 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:37:59.095 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 125 k 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:37:59.097 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:37:59.097 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:37:59.097 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:37:59.097 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 125 k 2024-09-11T14:37:59.097 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 445 k 2024-09-11T14:37:59.097 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:37:59.285 INFO:teuthology.orchestra.run.smithi052.stdout:librados-devel-19.3.0-4872.g0d61375b.el9.x86_64 666 kB/s | 125 kB 00:00 2024-09-11T14:37:59.285 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:37:59.286 INFO:teuthology.orchestra.run.smithi052.stdout:Total 659 kB/s | 125 kB 00:00 2024-09-11T14:37:59.286 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:37:59.292 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:37:59.292 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:37:59.359 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:37:59.360 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:37:59.519 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:37:59.627 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:00.068 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:00.340 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:00.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:00.340 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:38:00.340 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:38:00.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:00.340 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:00.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs2 2024-09-11T14:38:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:13 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:01.336 INFO:teuthology.orchestra.run.smithi052.stdout:Package libcephfs2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:01.383 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:01.384 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:01.384 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:01.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs-devel 2024-09-11T14:38:02.051 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:02.191 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:02.191 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 32 k 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 32 k 2024-09-11T14:38:02.192 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 142 k 2024-09-11T14:38:02.193 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:38:02.354 INFO:teuthology.orchestra.run.smithi052.stdout:libcephfs-devel-19.3.0-4872.g0d61375b.el9.x86_6 196 kB/s | 32 kB 00:00 2024-09-11T14:38:02.355 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:38:02.355 INFO:teuthology.orchestra.run.smithi052.stdout:Total 195 kB/s | 32 kB 00:00 2024-09-11T14:38:02.355 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:38:02.359 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:38:02.359 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:38:02.374 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:38:02.374 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:38:02.471 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:38:02.579 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:02.980 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:03.206 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:03.206 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:03.206 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:38:03.206 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:38:03.206 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:03.207 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:03.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados2 2024-09-11T14:38:03.975 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:15 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:04.068 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:04.114 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:04.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librbd1 2024-09-11T14:38:04.782 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:16 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:04.876 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:04.923 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:04.924 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:04.924 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:05.002 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rados 2024-09-11T14:38:05.595 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:17 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:05.686 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rados-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:05.733 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:05.734 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:05.734 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:05.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rgw 2024-09-11T14:38:06.404 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:06.500 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rgw-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:06.546 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:06.547 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:06.547 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:06.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-cephfs 2024-09-11T14:38:07.219 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:19 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:07.314 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-cephfs-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:07.361 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:07.362 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:07.362 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:07.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rbd 2024-09-11T14:38:08.033 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:08.128 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rbd-2:19.3.0-4872.g0d61375b.el9.x86_64 is already installed. 2024-09-11T14:38:08.174 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:08.175 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-11T14:38:08.176 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:08.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-fuse 2024-09-11T14:38:08.846 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:08.985 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:08.986 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:08.986 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-11T14:38:08.986 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:08.986 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:38:08.986 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 91 k 2024-09-11T14:38:08.986 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 91 k 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 321 k 2024-09-11T14:38:08.987 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:38:09.215 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-fuse-19.3.0-4872.g0d61375b.el9.x86_64.rpm 398 kB/s | 91 kB 00:00 2024-09-11T14:38:09.216 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:38:09.216 INFO:teuthology.orchestra.run.smithi052.stdout:Total 396 kB/s | 91 kB 00:00 2024-09-11T14:38:09.216 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:38:09.226 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:38:09.226 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:38:09.295 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:38:09.295 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:38:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:38:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:09.968 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:10.257 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:10.257 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:10.257 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:38:10.257 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:38:10.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:10.258 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:10.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-mirror 2024-09-11T14:38:11.153 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:23 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:11.298 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:11.298 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:11.298 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-11T14:38:11.298 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:11.298 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:38:11.298 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 3.5 M 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 3.5 M 2024-09-11T14:38:11.299 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 30 M 2024-09-11T14:38:11.300 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:38:11.852 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-mirror-19.3.0-4872.g0d61375b.el9.x86_64.rpm 6.4 MB/s | 3.5 MB 00:00 2024-09-11T14:38:11.852 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:38:11.853 INFO:teuthology.orchestra.run.smithi052.stdout:Total 6.3 MB/s | 3.5 MB 00:00 2024-09-11T14:38:11.853 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:38:11.865 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:38:11.866 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:38:11.954 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:38:11.954 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:38:12.575 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:38:12.644 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:12.672 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:12.672 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:38:12.672 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:38:12.672 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:38:12.672 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:38:12.672 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:13.947 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:38:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:38:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:13.947 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:14.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-nbd 2024-09-11T14:38:14.795 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:26 ago on Wed 11 Sep 2024 02:35:48 PM UTC. 2024-09-11T14:38:14.935 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.3.0-4872.g0d61375b.el9 ceph 177 k 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-11T14:38:14.936 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-11T14:38:14.937 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:14.937 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 177 k 2024-09-11T14:38:14.937 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 685 k 2024-09-11T14:38:14.937 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-11T14:38:15.137 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-nbd-19.3.0-4872.g0d61375b.el9.x86_64.rpm 880 kB/s | 177 kB 00:00 2024-09-11T14:38:15.138 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:38:15.138 INFO:teuthology.orchestra.run.smithi052.stdout:Total 874 kB/s | 177 kB 00:00 2024-09-11T14:38:15.139 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-11T14:38:15.149 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-11T14:38:15.149 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-11T14:38:15.217 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-11T14:38:15.217 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-11T14:38:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-11T14:38:15.497 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:15.947 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:16.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 1/1 2024-09-11T14:38:16.197 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:16.197 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-11T14:38:16.197 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.3.0-4872.g0d61375b.el9.x86_64 2024-09-11T14:38:16.197 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:16.197 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-11T14:38:16.476 DEBUG:teuthology.parallel:result is None 2024-09-11T14:38:16.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:38:16.617 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:38:16.639 INFO:teuthology.orchestra.run.smithi052.stdout:19.3.0-4872.g0d61375b.el9 2024-09-11T14:38:16.640 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4872.g0d61375b.el9 2024-09-11T14:38:16.640 INFO:teuthology.task.install:The correct ceph version 19.3.0-4872.g0d61375b is installed. 2024-09-11T14:38:16.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-11T14:38:16.779 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:38:16.804 INFO:teuthology.orchestra.run.smithi143.stdout:19.3.0-4872.g0d61375b.el9 2024-09-11T14:38:16.805 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4872.g0d61375b.el9 2024-09-11T14:38:16.805 INFO:teuthology.task.install:The correct ceph version 19.3.0-4872.g0d61375b is installed. 2024-09-11T14:38:16.806 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T14:38:16.807 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:16.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:38:16.834 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:16.834 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:38:16.874 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T14:38:16.874 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:16.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:38:16.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:38:16.967 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:16.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:38:16.996 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:38:17.063 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T14:38:17.063 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:17.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:38:17.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:38:17.164 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:17.164 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:38:17.192 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:38:17.258 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T14:38:17.259 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:17.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:38:17.284 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:38:17.349 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:17.349 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:38:17.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:38:17.441 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T14:38:17.526 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T14:38:17.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-09-11T14:38:17.529 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-09-11T14:38:17.553 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T14:38:17.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:38:17.595 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:38:17.620 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T14:38:17.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:38:17.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:38:17.697 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T14:38:17.697 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T14:38:17.697 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369', 'branch': 'main', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7901369', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'workunit': {'branch': 'wip-matanb-crimson-seastore-logs', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'dbebf1a3db6db7b5579464ee715edcf1b3e9cce2'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5813, 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-matanb-crimson-seastore-logs', 'suite_path': '/home/teuthworker/src/github.com_matan-b_ceph_dbebf1a3db6db7b5579464ee715edcf1b3e9cce2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/matan-b/ceph.git', 'suite_sha1': 'dbebf1a3db6db7b5579464ee715edcf1b3e9cce2', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzRn0lMGhlT2LdcaP+MUNHJcz9qTV5JWtOvy6rbdevBvfZUjBjwmoDViR21wmzmUndgccA72i6w+Blw7x9FJi0=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzXypM7P52WgmhQ88tXpo0Ro/mpKcn/ueeg3f0aMYua9oaEdxZJsSlzcFRyiNpasZQKjqP9doPXIH/IgTl7DvM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_13:56:22', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T14:38:17.698 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:38:17.727 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:38:17.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:38:17.783 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:38:17.808 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:17.808 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:38:17.863 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:38:17.863 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-11T14:38:17.918 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:38:17.918 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-11 14:38:12.924845543 +0000 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-11 14:34:54.492213880 +0000 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-11 14:34:54.492213880 +0000 2024-09-11T14:38:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-11 14:34:54.492213880 +0000 2024-09-11T14:38:17.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:38:17.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-11T14:38:17.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-11T14:38:17.983 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000103039 s, 5.0 MB/s 2024-09-11T14:38:17.984 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:38:18.042 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-11T14:38:18.097 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-11 14:38:12.924845543 +0000 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-11 14:34:54.820210209 +0000 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-11 14:34:54.820210209 +0000 2024-09-11T14:38:18.098 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-11 14:34:54.820210209 +0000 2024-09-11T14:38:18.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:38:18.161 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-11T14:38:18.161 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-11T14:38:18.161 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000100228 s, 5.1 MB/s 2024-09-11T14:38:18.163 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:38:18.219 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-11 14:38:12.925845531 +0000 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-11 14:34:55.133206706 +0000 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-11 14:34:55.133206706 +0000 2024-09-11T14:38:18.276 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-11 14:34:55.133206706 +0000 2024-09-11T14:38:18.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-11T14:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-11T14:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 8.2339e-05 s, 6.2 MB/s 2024-09-11T14:38:18.341 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:38:18.398 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-11T14:38:18.454 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:38:18.454 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:18.454 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T14:38:18.455 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:18.455 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:18.455 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-11 14:38:12.925845531 +0000 2024-09-11T14:38:18.455 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-11 14:34:55.451203148 +0000 2024-09-11T14:38:18.455 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-11 14:34:55.451203148 +0000 2024-09-11T14:38:18.455 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-11 14:34:55.451203148 +0000 2024-09-11T14:38:18.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:38:18.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-11T14:38:18.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-11T14:38:18.518 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000100847 s, 5.1 MB/s 2024-09-11T14:38:18.520 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:38:18.576 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:38:18.576 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:18.577 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:38:18.594 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:38:18.594 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-11 14:37:53.976049287 +0000 2024-09-11T14:38:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-11 14:34:50.468403925 +0000 2024-09-11T14:38:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-11 14:34:50.468403925 +0000 2024-09-11T14:38:18.652 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-11 14:34:50.468403925 +0000 2024-09-11T14:38:18.652 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:38:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-11T14:38:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-11T14:38:18.716 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00021554 s, 2.4 MB/s 2024-09-11T14:38:18.717 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:38:18.775 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-09-11T14:38:18.832 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-11 14:37:53.976049287 +0000 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-11 14:34:50.796395049 +0000 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-11 14:34:50.796395049 +0000 2024-09-11T14:38:18.833 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-11 14:34:50.796395049 +0000 2024-09-11T14:38:18.833 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:38:18.898 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-11T14:38:18.898 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-11T14:38:18.898 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000218644 s, 2.3 MB/s 2024-09-11T14:38:18.899 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:38:18.957 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-09-11T14:38:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:38:19.014 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-11 14:37:53.977049261 +0000 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-11 14:34:51.102386771 +0000 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-11 14:34:51.102386771 +0000 2024-09-11T14:38:19.015 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-11 14:34:51.102386771 +0000 2024-09-11T14:38:19.015 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:38:19.079 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-11T14:38:19.080 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-11T14:38:19.080 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000217415 s, 2.4 MB/s 2024-09-11T14:38:19.081 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:38:19.138 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-11 14:37:53.977049261 +0000 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-11 14:34:51.413378358 +0000 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-11 14:34:51.413378358 +0000 2024-09-11T14:38:19.194 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-11 14:34:51.413378358 +0000 2024-09-11T14:38:19.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:38:19.258 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-11T14:38:19.258 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-11T14:38:19.258 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000154464 s, 3.3 MB/s 2024-09-11T14:38:19.259 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:38:19.316 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:38:19.316 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:38:19.316 INFO:tasks.ceph:Generating config... 2024-09-11T14:38:19.317 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T14:38:19.318 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-11T14:38:19.318 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-11T14:38:19.318 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore backref = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore cache = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore device = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore epm = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore journal = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore lba = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore odata = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore ompap = 20 2024-09-11T14:38:19.319 INFO:tasks.ceph:[osd] debug seastore onode = 20 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] debug seastore t = 20 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] debug seastore tm = 20 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-11T14:38:19.320 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T14:38:19.320 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-11T14:38:19.320 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-11T14:38:19.321 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T14:38:19.321 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T14:38:19.321 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-11T14:38:19.321 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-11T14:38:19.321 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-11T14:38:19.321 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-11T14:38:19.321 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T14:38:19.321 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T14:38:19.389 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T14:38:19.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T14:38:19.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:38:19.477 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52')] 2024-09-11T14:38:19.477 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore ompap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-11T14:38:19.478 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:19.478 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:38:19.532 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:19.625+0000 7fa27fe32f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:19.625+0000 7fa27fe32f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:19.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:19.626+0000 7fa27fe32f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:19.628 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:19.628 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid a6b5d4a4-66d9-4a76-9e4a-eb916006be26 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:fsid a6b5d4a4-66d9-4a76-9e4a-eb916006be26 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-09-11T14:38:19.627997+0000 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-11T14:38:19.627997+0000 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-11T14:38:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T14:38:19.631 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:38:19.646 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a6b5d4a4-66d9-4a76-9e4a-eb916006be26... 2024-09-11T14:38:19.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:38:19.688 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:38:19.730 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-11T14:38:19.730 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-11T14:38:19.730 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.731 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-11T14:38:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-11T14:38:19.733 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = 172.21.15.52 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: ms client mode = crc 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: ms cluster mode = crc 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: ms mon client mode = crc 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: ms mon cluster mode = crc 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: ms mon service mode = crc 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: ms service mode = crc 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = a6b5d4a4-66d9-4a76-9e4a-eb916006be26 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-11T14:38:19.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.735 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-11T14:38:19.736 INFO:teuthology.orchestra.run.smithi052.stdout: debug monc = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: crimson osd obc lru size = 10 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore backref = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore cache = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore cleaner = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore device = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore epm = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore fixedkv tree = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore journal = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore lba = 20 2024-09-11T14:38:19.737 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore odata = 20 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore ompap = 20 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore onode = 20 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore t = 20 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: debug seastore tm = 20 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd class default list = * 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd class load list = * 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = seastore 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd shutdown pgref assert = True 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-11T14:38:19.738 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-11T14:38:19.739 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-11T14:38:19.740 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: mon min osdmap epochs = 50 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune interval = 2 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune min = 15 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: paxos service trim min = 10 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on pool no app = False 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default crimson = True 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-11T14:38:19.741 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-09-11T14:38:19.742 INFO:teuthology.orchestra.run.smithi052.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-09-11T14:38:19.743 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:38:19.744 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-09-11T14:38:19.745 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = 172.21.15.52 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: ms client mode = crc 2024-09-11T14:38:19.746 INFO:teuthology.orchestra.run.smithi143.stdout: ms cluster mode = crc 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: ms mon client mode = crc 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: ms mon cluster mode = crc 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: ms mon service mode = crc 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: ms service mode = crc 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = a6b5d4a4-66d9-4a76-9e4a-eb916006be26 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:38:19.747 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.748 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: debug monc = 20 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: crimson osd obc lru size = 10 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-09-11T14:38:19.749 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore backref = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore cache = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore cleaner = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore device = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore epm = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore fixedkv tree = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore journal = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore lba = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore odata = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore ompap = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore onode = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore t = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: debug seastore tm = 20 2024-09-11T14:38:19.750 INFO:teuthology.orchestra.run.smithi143.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: osd class default list = * 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: osd class load list = * 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = seastore 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: osd shutdown pgref assert = True 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-09-11T14:38:19.751 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:38:19.752 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon min osdmap epochs = 50 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon osdmap full prune interval = 2 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon osdmap full prune min = 15 2024-09-11T14:38:19.753 INFO:teuthology.orchestra.run.smithi143.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: paxos service trim min = 10 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on pool no app = False 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default crimson = True 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2024-09-11T14:38:19.754 INFO:teuthology.orchestra.run.smithi143.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:38:19.755 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2024-09-11T14:38:19.755 INFO:teuthology.orchestra.run.smithi143.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:38:19.755 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2024-09-11T14:38:19.755 INFO:teuthology.orchestra.run.smithi143.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:38:19.755 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2024-09-11T14:38:19.755 INFO:teuthology.orchestra.run.smithi143.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:38:19.756 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T14:38:19.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T14:38:19.862 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T14:38:19.862 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:19.862 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T14:38:19.878 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:19.878 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T14:38:19.933 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:38:19.933 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:19.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:38:19.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:38:20.010 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:20.010 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:20.066 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:38:20.066 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:20.067 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:38:20.067 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:38:20.104 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:20.104 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:20.160 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T14:38:20.161 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T14:38:20.161 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:38:20.290 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:38:20.293 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T14:38:20.294 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T14:38:20.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T14:38:20.346 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T14:38:20.360 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T14:38:20.410 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T14:38:20.423 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T14:38:20.423 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:38:20.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T14:38:20.449 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:38:20.449 INFO:tasks.ceph:role: osd.0 2024-09-11T14:38:20.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:38:20.450 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:38:20.515 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:38:20.516 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:38:20.516 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:38:20.548 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-11T14:38:20.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-11T14:38:20.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T14:38:20.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T14:38:20.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T14:38:20.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:38:20.756 INFO:tasks.ceph:role: osd.1 2024-09-11T14:38:20.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:38:20.757 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:38:20.822 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:38:20.823 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:38:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-11T14:38:20.857 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-11T14:38:20.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T14:38:20.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T14:38:20.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:21.301 INFO:teuthology.orchestra.run.smithi052.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:21.302 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:21,302 seastar - Reactor backend: linux-aio 2024-09-11T14:38:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:==27775==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4c650 0x5ef3005 0x5ef86a9 0x5ef8cf0 0x5eeacce 0x5e1ef95 0x5e1ff3a 0x715ebc2 0x7170395 0x7171832 0x71718b7 0x71719b9 0x7171ab1 0x7171cbe 0x7171ea4 0x71721f3 0x7172597 0x71727c7 0x7172a31 0x7172cfe 0x7172f1c 0x7172fd4 0x717309a 0x717317b 0x5c6b026 0x5c6b130 0x5c6b1ec 0x5c6b2a8 0x5c6b364 0x5c6b4b1 0x5c6b63c 0x5c6b9fd 0x5c85800 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x3968bb0 0x396a38a 0x380ac18 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:21.425 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:21.446 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:21,446 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:38:21.447 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:21,446 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:38:21.447 INFO:teuthology.orchestra.run.smithi052.stderr:DEBUG 2024-09-11 14:38:21,447 [shard 0:main] seastar - reactor::drain 2024-09-11T14:38:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:Suppressions used: 2024-09-11T14:38:21.983 INFO:teuthology.orchestra.run.smithi052.stderr: count bytes template 2024-09-11T14:38:21.984 INFO:teuthology.orchestra.run.smithi052.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:21.984 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:38:22.046 INFO:teuthology.orchestra.run.smithi052.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:22.050 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:22,049 seastar - Reactor backend: linux-aio 2024-09-11T14:38:22.060 INFO:teuthology.orchestra.run.smithi052.stderr:==27773==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xfb553 0x376ee9b 0xb9d9bfe 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xc9199 0xc9e39 0x360e4e8 0x3b92070 0x3b92268 0xb9f075a 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f3fd3 0xba38ebd 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.421 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4b233 0x36e3813 0x36e83be 0xba11c4b 0xba295d2 0xba2979b 0xb9d1e3e 0xb9d64f1 0x984ae51 0x9ab876a 0x9b05946 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.421 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xb85b0f9 0xb85b621 0xb85ba2c 0xb85bceb 0xba2da49 0xba2fa57 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9ab9cb7 0x9b05946 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x41e59 0x4214e 0x3ecea 0xfc9b1 0x3870209 0xb85a732 0xb85a87a 0xb85a963 0xb85ac23 0xb85ad16 0xb85adf6 0xb85b076 0xb85b621 0xb85ba2c 0xb85bceb 0xb9e2239 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x95eaee9 0x95eb495 0x9b00d8b 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.520 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x156f9 0xdd312 0x4ab1c 0x3acdafe 0x3b9225d 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xba39371 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.521 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.521 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xba0df0b 0xba3b3ff 0xba3ba49 0xb9d61d4 0x984ae51 0x9b01034 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.521 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4c5f9 0xba0c8a9 0xba3b3ff 0xba3ba49 0xb9d61d4 0x984ae51 0x9b0161a 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xb9eac8a 0xb9eaf87 0xb9d2faf 0xba2fa98 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.620 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549fa2 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:22.620 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.677 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:22.677 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549172 0x554a11c 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554a082 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:23.016 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x10798d 0xdd2fc 0x4b14c 0x611b593 0x611b717 0x611b99f 0xba3becf 0xba3bfb6 0xba3c1ec 0xba3c388 0xba3c71e 0xba3c930 0xb9d97af 0xb9d9bd4 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b024e4 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96b12ac 0x96b1648 0x96b17cd 0x96b186f 0x96b1988 0xbe4ccc9 0xbe4ced0 0xbe4cfa6 0xbe4d0e1 0xbe4d4d5 0xbe4c898 0xbe4c978 0xbe4ca8c 0xbe4c74f 0x950f650 0x95f4692 0x9328541 0x932871b 0x9328856 0x9328910 0x93289ea 0x9328f36 0x932920e 0x93292c3 0x95a401c 0x95a4281 0x95d24b8 0x96d5c66 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:23.017 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:Suppressions used: 2024-09-11T14:38:24.166 INFO:teuthology.orchestra.run.smithi052.stderr: count bytes template 2024-09-11T14:38:24.166 INFO:teuthology.orchestra.run.smithi052.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:24.166 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:38:24.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T14:38:24.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:24,515 seastar - Reactor backend: linux-aio 2024-09-11T14:38:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:==27822==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:24.654 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:24,653 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:38:24.654 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:24,653 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:38:24.654 INFO:teuthology.orchestra.run.smithi052.stderr:DEBUG 2024-09-11 14:38:24,654 [shard 0:main] seastar - reactor::drain 2024-09-11T14:38:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:Suppressions used: 2024-09-11T14:38:25.185 INFO:teuthology.orchestra.run.smithi052.stderr: count bytes template 2024-09-11T14:38:25.185 INFO:teuthology.orchestra.run.smithi052.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:25.186 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:38:25.250 INFO:teuthology.orchestra.run.smithi052.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:25.254 INFO:teuthology.orchestra.run.smithi052.stderr:INFO 2024-09-11 14:38:25,254 seastar - Reactor backend: linux-aio 2024-09-11T14:38:25.265 INFO:teuthology.orchestra.run.smithi052.stderr:==27820==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:25.329 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x124fa7 0x44735 0xfe5da 0x362d869 0x362d983 0x5fc0d0a 0x5e081e5 0x5e20427 0x715ebc2 0x7170395 0x7171832 0x71718b7 0x71719b9 0x7171ab1 0x7171cbe 0x7171ea4 0x71721f3 0x7172597 0x71727c7 0x7172a31 0x7172cfe 0x7172f1c 0x7172fd4 0x717309a 0x717317b 0x5c6b026 0x5c6b130 0x5c6b1ec 0x5c6b2a8 0x5c6b364 0x5c6b4b1 0x5c6b63c 0x5c6b9fd 0x5c85800 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.567 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd2cf 0x4ab1c 0x3acdafe 0x3b9225d 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.567 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xc93f6 0xc9e39 0x360e4e8 0x3b92070 0x3b92268 0xba052ce 0xba407e3 0xba40b6e 0xb9e0f68 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.568 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.568 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.625 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4abf9 0x454eb34 0xb9d982a 0xb9d9bd4 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9ab9cb7 0x9b057b2 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.625 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x420d8 0x3ecea 0xfc9b1 0x3870209 0xba2d8b2 0xba312a0 0xb9e403b 0xb9ced56 0xb9cf13a 0x9ab9cb7 0x9b05476 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.625 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.625 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.626 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xba057c3 0xba407e3 0xba40b6e 0xb9e0f68 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:25.626 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.683 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xc9232 0xc9e39 0x360e4e8 0x3b92070 0x3b92268 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:25.684 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 33 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x1597bf 0xc928c 0xc9e39 0x360e4e8 0x3b92070 0x3b92268 0xb9f768b 0xb9f7940 0xb9d9e90 0xb9dac55 0xb9db0d7 0xb9db2ec 0xb9ef553 0xb9ef792 0xb9cc6b1 0xb9cc76a 0x9b19e2d 0x9986c2a 0x9986e46 0x9949ae9 0x9949ce6 0x94d3fd3 0x94d8371 0x927b931 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x8b55b 0x10d76c 0xdd31a 0x4b14c 0x3b920e7 0x3b92268 0xb9f075a 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f3fd3 0xba38ebd 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 91 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x61204f3 0x61209b9 0x6120a76 0xb9d9793 0xb9d9bd4 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.785 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x37806ed 0x3b921a4 0x3b92268 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x927c472 0x927c98e 0x927cb17 0x927cd5e 0x927d036 0x927d0eb 0x959a3a8 0x959a60d 0x95d25f3 0x96d6bde 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.785 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.824 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4ab0b 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:25.824 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.881 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4aaff 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:25.882 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.922 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd323 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd2cf 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:kernel callstack: 2024-09-11T14:38:27.367 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:27.367 INFO:teuthology.orchestra.run.smithi052.stderr:Suppressions used: 2024-09-11T14:38:27.367 INFO:teuthology.orchestra.run.smithi052.stderr: count bytes template 2024-09-11T14:38:27.367 INFO:teuthology.orchestra.run.smithi052.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:27.367 INFO:teuthology.orchestra.run.smithi052.stderr:----------------------------------------------------- 2024-09-11T14:38:27.367 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:38:27.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T14:38:27.421 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T14:38:27.454 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:38:27.454 INFO:tasks.ceph:role: osd.2 2024-09-11T14:38:27.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:38:27.454 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:38:27.530 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:38:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:38:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:38:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:38:27.530 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:38:27.530 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:38:27.531 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:38:27.531 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:38:27.531 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:38:27.531 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:38:28.034 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-11T14:38:28.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-11T14:38:28.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-11T14:38:28.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T14:38:28.209 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T14:38:28.277 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:38:28.277 INFO:tasks.ceph:role: osd.3 2024-09-11T14:38:28.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:38:28.277 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:38:28.352 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:38:28.800 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-11T14:38:28.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-11T14:38:28.803 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-11T14:38:28.894 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T14:38:28.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:29.238 INFO:teuthology.orchestra.run.smithi143.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:29,239 seastar - Reactor backend: linux-aio 2024-09-11T14:38:29.250 INFO:teuthology.orchestra.run.smithi143.stderr:==27773==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:29.376 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:29,375 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:38:29.376 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:29,375 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:38:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:DEBUG 2024-09-11 14:38:29,376 [shard 0:main] seastar - reactor::drain 2024-09-11T14:38:29.881 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:Suppressions used: 2024-09-11T14:38:29.882 INFO:teuthology.orchestra.run.smithi143.stderr: count bytes template 2024-09-11T14:38:29.882 INFO:teuthology.orchestra.run.smithi143.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:29.882 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-11T14:38:29.936 INFO:teuthology.orchestra.run.smithi143.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:29,939 seastar - Reactor backend: linux-aio 2024-09-11T14:38:29.949 INFO:teuthology.orchestra.run.smithi143.stderr:==27771==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:30.234 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xff346 0x425e1 0x3ef7b 0xfd531 0xb85ab4d 0xb85ac00 0xba2e325 0xba2e414 0xba2ead4 0xba2ec3f 0xba2f101 0xb9d3249 0xba2fa98 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.234 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.235 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133c2b 0xdd332 0x4ab1c 0x5c9746e 0xb9f1e62 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.235 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.292 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x41e6b 0x4214e 0x3ecea 0xfc9b1 0x3870209 0xb9d59f4 0x984ae51 0xacc44dd 0x9a0741b 0x9a07c77 0x98fcbb0 0x93358b1 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.292 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.292 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x41d85 0x4214e 0x3ef7b 0xfd531 0xb85ab4d 0xb85ac00 0xba2e325 0xba2e414 0xba2e694 0xba2ec3f 0xba2f101 0xb9d3249 0xba2fa98 0xba2fcdf 0xba2fd8f 0xb9df75d 0xb9e3db8 0xb9ced56 0xb9cf13a 0xacc4d28 0x9a0741b 0x9a07c77 0x98fcbb0 0x93358b1 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.292 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.483 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549b5e 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:30.483 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.540 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x8b571 0x10d76c 0xdd31a 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:30.541 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.576 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549297 0x9e3b019 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.576 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.576 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x10798d 0xdd2fc 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.576 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.634 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xdd323 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.634 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.634 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133d0c 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.634 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.938 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xc6217 0x5c94239 0xb9f1b6a 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4b217 0xb9f1ec8 0xb9f201c 0xb9f45e7 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:31.072 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549f6b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:31.073 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:31.130 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554a2a9 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:31.130 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549fa6 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:32.042 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:32.042 INFO:teuthology.orchestra.run.smithi143.stderr:Suppressions used: 2024-09-11T14:38:32.042 INFO:teuthology.orchestra.run.smithi143.stderr: count bytes template 2024-09-11T14:38:32.042 INFO:teuthology.orchestra.run.smithi143.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:32.043 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:32.043 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-11T14:38:32.070 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T14:38:32.094 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:32.371 INFO:teuthology.orchestra.run.smithi143.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:32.372 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:32,371 seastar - Reactor backend: linux-aio 2024-09-11T14:38:32.377 INFO:teuthology.orchestra.run.smithi143.stderr:==27820==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:32.497 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:32,497 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:38:32.498 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:32,497 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:38:32.498 INFO:teuthology.orchestra.run.smithi143.stderr:DEBUG 2024-09-11 14:38:32,498 [shard 0:main] seastar - reactor::drain 2024-09-11T14:38:33.000 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:33.000 INFO:teuthology.orchestra.run.smithi143.stderr:Suppressions used: 2024-09-11T14:38:33.000 INFO:teuthology.orchestra.run.smithi143.stderr: count bytes template 2024-09-11T14:38:33.000 INFO:teuthology.orchestra.run.smithi143.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:33.000 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:33.000 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-11T14:38:33.068 INFO:teuthology.orchestra.run.smithi143.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:38:33.071 INFO:teuthology.orchestra.run.smithi143.stderr:INFO 2024-09-11 14:38:33,071 seastar - Reactor backend: linux-aio 2024-09-11T14:38:33.087 INFO:teuthology.orchestra.run.smithi143.stderr:==27818==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:38:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5c49651 0xb85c5f8 0xba2d476 0xb9d2631 0x9b01071 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0xb9f3c94 0xb9f4222 0xb9e014c 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.371 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.428 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x3973001 0x5c124af 0x5c16e23 0x5e71a9a 0x5e71d3c 0x5e0e2e8 0x5e1a302 0x5e1b192 0x4f18f39 0x4f191ec 0x959a84e 0xac9c698 0xad02411 0xaccefd1 0x994da0a 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.429 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x997deb6 0x9b9bef4 0x9cb2df1 0x9cb36ec 0x9b19303 0x99a9828 0x994a011 0x927bd5d 0x93356ad 0x933664c 0x93366cf 0x9336754 0x9336856 0x933694e 0x93369d4 0x9336a8d 0x9336c43 0x9336d7b 0x9336df6 0x9336e7b 0x9336fd6 0x93370f0 0x9337175 0x9337253 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.429 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.429 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.638 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549b0e 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:33.638 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.695 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x133c6b 0xdd332 0x4ab1c 0x554a17b 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:33.696 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.733 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549aed 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.734 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.734 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554966e 0x9e3b02e 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.734 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.791 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x554a170 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.791 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:33.791 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x9e3aff4 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:33.791 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:34.087 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x76e22cd 0xba2793e 0xba323fd 0xba325c9 0xb9d96a5 0xb9d9bd4 0xb9dfb97 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:34.088 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x4abab 0x3acdafe 0x3b9225d 0xb9f0927 0xb9f1bfa 0xb9f1e74 0xb9f201c 0xb9f3dd7 0xb9f3fd3 0xba38ebd 0xb9e038f 0xb9e3db8 0xb9ced56 0xb9cf13a 0x9b016e3 0x9b19232 0x99a9828 0x994a011 0x927bd5d 0x93195d6 0x931a07a 0x931a0fd 0x931a182 0x931a284 0x931a37c 0x931a402 0x931a4bb 0x931a671 0x931a7a9 0x931a824 0x931a8a9 0x931aa04 0x931ab1e 0x931aba3 0x931ac81 0x9559f46 0x9622cb3 0x9622e30 0x96e3b91 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc7466b 0xbc74ced 0x7b37e35 0xc60a404 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:38:34.088 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:34.088 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:34.221 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549a93 0x9e3b03b 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:34.222 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:34.279 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x5549f89 0x9e3b000 0x9eaa4f9 0x9edacf1 0x9e42284 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:34.279 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:34.387 INFO:teuthology.orchestra.run.smithi143.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbcafa0f 0xbb88399 0xbb89904 0xbb89b1a 0xbb89c70 0xbb8a139 0x3e6ef 0x9e49858 0x9df16fb 0x9e422af 0x9960817 0x987fc22 0x98a42e2 0x98a4441 0x98b5cde 0x98b5eae 0x98b61bc 0x98b64cb 0x98b662a 0x98b66a5 0x98b68ec 0x98b6bb0 0x98b6c40 0x98b6ce4 0x95cab72 0x95cadd7 0x95d337c 0x96c5a26 0xbb9c947 0xbbb47c5 0xbc6206f 0xbc636bd 0xb931f8d 0xb9327c5 0x380b428 0x2958f 0x2963f 0x35f29a4 2024-09-11T14:38:34.387 INFO:teuthology.orchestra.run.smithi143.stderr:kernel callstack: 2024-09-11T14:38:35.161 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:35.162 INFO:teuthology.orchestra.run.smithi143.stderr:Suppressions used: 2024-09-11T14:38:35.162 INFO:teuthology.orchestra.run.smithi143.stderr: count bytes template 2024-09-11T14:38:35.162 INFO:teuthology.orchestra.run.smithi143.stderr: 1 8 MallocExtension::Register 2024-09-11T14:38:35.162 INFO:teuthology.orchestra.run.smithi143.stderr:----------------------------------------------------- 2024-09-11T14:38:35.162 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-11T14:38:35.188 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T14:38:35.213 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T14:38:35.213 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:35.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T14:38:35.244 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:35.244 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T14:38:35.315 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:35.315 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T14:38:35.339 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:35.339 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T14:38:35.404 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:35.405 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T14:38:35.469 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:35.469 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T14:38:35.489 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:35.489 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T14:38:35.525 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T14:38:35.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T14:38:35.559 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-09-11T14:38:35.559 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBeq+Fm0TQhDRAAm3k+Ehoc9c+iKbavRW7xSg== 2024-09-11T14:38:35.559 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-09-11T14:38:35.560 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBhq+FmNMsvGRAAd6HGYangnuD1juzpZDiseQ== 2024-09-11T14:38:35.560 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-09-11T14:38:35.560 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBcq+FmgI1PERAAktgufolZgJiWnKYf7F0s2w== 2024-09-11T14:38:35.560 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-09-11T14:38:35.560 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBmq+FmCamzBRAAhnsAbttsCkNGKPba7rCjCw== 2024-09-11T14:38:35.560 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-09-11T14:38:35.561 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBpq+FmK1bTDRAAzzadsgw6WX4Wc3NaeIP1QQ== 2024-09-11T14:38:35.561 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-11T14:38:35.561 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBcq+FmYdelFBAA/Is/pE87qjsBM7zth1iOng== 2024-09-11T14:38:35.561 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2024-09-11T14:38:35.561 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBcq+FmY+VyGBAAKuDX4LuKSO+HgRdfFJ5qmA== 2024-09-11T14:38:35.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:38:35.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:38:35.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T14:38:35.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:38:35.866 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:38:35.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:38:35.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:38:36.061 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T14:38:36.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T14:38:36.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T14:38:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.199+0000 7f72dcedfc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.199+0000 7f72dcedfc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T14:38:36.239 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:38:36.294 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T14:38:36.294 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T14:38:36.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T14:38:36.337 INFO:tasks.ceph.mon.a:Started 2024-09-11T14:38:36.337 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T14:38:36.337 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T14:38:36.338 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T14:38:36.340 INFO:tasks.ceph.mgr.x:Started 2024-09-11T14:38:36.340 DEBUG:tasks.ceph:set 0 configs 2024-09-11T14:38:36.341 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T14:38:36.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T14:38:36.422 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-11T14:38:36.421+0000 7f2cb68d3c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.422 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-11T14:38:36.421+0000 7f2cb68d3c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.423 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-11T14:38:36.421+0000 7f2cb68d3c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.437 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-09-11T14:38:36.434+0000 7faab6c32000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.449+0000 7fbfc2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.458+0000 7fbfc2791640 1 Processor -- start 2024-09-11T14:38:36.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.458+0000 7fbfc2791640 1 -- start start 2024-09-11T14:38:36.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.459+0000 7fbfc2791640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbfbc073d40 0x7fbfbc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:36.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.459+0000 7fbfc2791640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfbc0a2690 con 0x7fbfbc073220 2024-09-11T14:38:36.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.459+0000 7fbfc2791640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbfbc0a10a0 con 0x7fbfbc073d40 2024-09-11T14:38:36.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.459+0000 7fbfbbfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbfbc073220 0x7fbfbc073630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46020/0 (socket says 172.21.15.52:46020) 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.459+0000 7fbfbbfff640 1 -- 172.21.15.52:0/337321580 learned_addr learned my addr 172.21.15.52:0/337321580 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.459+0000 7fbfb3fff640 1 --2- 172.21.15.52:0/337321580 >> v2:172.21.15.52:3300/0 conn(0x7fbfbc073d40 0x7fbfbc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfbb7fe640 1 -- 172.21.15.52:0/337321580 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65470272 0 0) 0x7fbfbc0a2690 con 0x7fbfbc073220 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfbb7fe640 1 -- 172.21.15.52:0/337321580 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfa8003580 con 0x7fbfbc073220 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfb3fff640 1 -- 172.21.15.52:0/337321580 >> v1:172.21.15.52:6789/0 conn(0x7fbfbc073220 legacy=0x7fbfbc073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfb3fff640 1 -- 172.21.15.52:0/337321580 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc0a2380 con 0x7fbfbc073d40 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfb3fff640 1 --2- 172.21.15.52:0/337321580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073d40 0x7fbfbc13b160 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11eed0ce641a42a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfbb7fe640 1 -- 172.21.15.52:0/337321580 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfa4009d90 con 0x7fbfbc073d40 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfbb7fe640 1 -- 172.21.15.52:0/337321580 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbfa400e230 con 0x7fbfbc073d40 2024-09-11T14:38:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.460+0000 7fbfbb7fe640 1 -- 172.21.15.52:0/337321580 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfa400e4d0 con 0x7fbfbc073d40 2024-09-11T14:38:36.463 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-09-11T14:38:36.458+0000 7faab6c32000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.463 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-09-11T14:38:36.459+0000 7faab6c32000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 -- 172.21.15.52:0/337321580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073d40 msgr2=0x7fbfbc13b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 --2- 172.21.15.52:0/337321580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073d40 0x7fbfbc13b160 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 -- 172.21.15.52:0/337321580 shutdown_connections 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 --2- 172.21.15.52:0/337321580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073d40 0x7fbfbc13b160 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 -- 172.21.15.52:0/337321580 >> 172.21.15.52:0/337321580 conn(0x7fbfbc06f6e0 msgr2=0x7fbfbc071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 -- 172.21.15.52:0/337321580 shutdown_connections 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 1 -- 172.21.15.52:0/337321580 wait complete. 2024-09-11T14:38:36.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.461+0000 7fbfc2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.463+0000 7fbfc2791640 1 Processor -- start 2024-09-11T14:38:36.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.463+0000 7fbfc2791640 1 -- start start 2024-09-11T14:38:36.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.465+0000 7fbfc2791640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 0x7fbfbc124220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:36.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.465+0000 7fbfc2791640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1237b0 con 0x7fbfbc073220 2024-09-11T14:38:36.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.465+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 0x7fbfbc124220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:36.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.465+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 0x7fbfbc124220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42836/0 (socket says 172.21.15.52:42836) 2024-09-11T14:38:36.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.465+0000 7fbfbbfff640 1 -- 172.21.15.52:0/3876546955 learned_addr learned my addr 172.21.15.52:0/3876546955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:36.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.465+0000 7fbfbbfff640 1 -- 172.21.15.52:0/3876546955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc123d60 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.466+0000 7fbfbbfff640 1 --2- 172.21.15.52:0/3876546955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 0x7fbfbc124220 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.466+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfac005a60 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.466+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbfac005bc0 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.466+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfac005e60 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.466+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc126210 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.466+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc123a50 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.467+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fbfac007440 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.467+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7fbfac00f8e0 con 0x7fbfbc073220 2024-09-11T14:38:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.467+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc073630 con 0x7fbfbc073220 2024-09-11T14:38:36.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.469+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fbfac00fb40 con 0x7fbfbc073220 2024-09-11T14:38:36.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.536+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbfbc077360 con 0x7fbfbc073220 2024-09-11T14:38:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.537+0000 7fbfb97fa640 1 -- 172.21.15.52:0/3876546955 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7fbfac00fce0 con 0x7fbfbc073220 2024-09-11T14:38:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.537+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 msgr2=0x7fbfbc124220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.537+0000 7fbfc2791640 1 --2- 172.21.15.52:0/3876546955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 0x7fbfbc124220 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.537+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 shutdown_connections 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.537+0000 7fbfc2791640 1 --2- 172.21.15.52:0/3876546955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfbc073220 0x7fbfbc124220 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.537+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 >> 172.21.15.52:0/3876546955 conn(0x7fbfbc06f6e0 msgr2=0x7fbfbc0a50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.538+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 shutdown_connections 2024-09-11T14:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.538+0000 7fbfc2791640 1 -- 172.21.15.52:0/3876546955 wait complete. 2024-09-11T14:38:36.549 INFO:tasks.ceph:check_enable_crimson: True 2024-09-11T14:38:36.550 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-11T14:38:36.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-11T14:38:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.653+0000 7fd4954fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.660+0000 7fd4954fd640 1 Processor -- start 2024-09-11T14:38:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.660+0000 7fd4954fd640 1 -- start start 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd4954fd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd49009e6c0 0x7fd49009c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd4954fd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd490074a70 con 0x7fd49009cf20 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd4954fd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd4900a61f0 con 0x7fd49009e6c0 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd49009e6c0 0x7fd49009c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48e7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd49009cf20 0x7fd490133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46030/0 (socket says 172.21.15.52:46030) 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48e7fc640 1 -- 172.21.15.52:0/2366359546 learned_addr learned my addr 172.21.15.52:0/2366359546 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48effd640 1 -- 172.21.15.52:0/2366359546 >> v1:172.21.15.52:6789/0 conn(0x7fd49009cf20 legacy=0x7fd490133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48effd640 1 -- 172.21.15.52:0/2366359546 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4900a5ee0 con 0x7fd49009e6c0 2024-09-11T14:38:36.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48dffb640 1 -- 172.21.15.52:0/2366359546 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603388818 0 0) 0x7fd490074a70 con 0x7fd49009cf20 2024-09-11T14:38:36.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.662+0000 7fd48effd640 1 --2- 172.21.15.52:0/2366359546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009e6c0 0x7fd49009c9e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5324526f9f6a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:36.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd48dffb640 1 -- 172.21.15.52:0/2366359546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd48000e040 con 0x7fd49009e6c0 2024-09-11T14:38:36.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd48dffb640 1 -- 172.21.15.52:0/2366359546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd480007670 con 0x7fd49009e6c0 2024-09-11T14:38:36.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd48dffb640 1 -- 172.21.15.52:0/2366359546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd480007910 con 0x7fd49009e6c0 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 -- 172.21.15.52:0/2366359546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009e6c0 msgr2=0x7fd49009c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 --2- 172.21.15.52:0/2366359546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009e6c0 0x7fd49009c9e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 -- 172.21.15.52:0/2366359546 shutdown_connections 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 --2- 172.21.15.52:0/2366359546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009e6c0 0x7fd49009c9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 -- 172.21.15.52:0/2366359546 >> 172.21.15.52:0/2366359546 conn(0x7fd4900a43e0 msgr2=0x7fd490073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 -- 172.21.15.52:0/2366359546 shutdown_connections 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.663+0000 7fd4954fd640 1 -- 172.21.15.52:0/2366359546 wait complete. 2024-09-11T14:38:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.664+0000 7fd4954fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.665+0000 7fd4954fd640 1 Processor -- start 2024-09-11T14:38:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.666+0000 7fd4954fd640 1 -- start start 2024-09-11T14:38:36.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.667+0000 7fd4954fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 0x7fd490120f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:36.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.667+0000 7fd4954fd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd490123e80 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.667+0000 7fd48effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 0x7fd490120f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.667+0000 7fd48effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 0x7fd490120f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42852/0 (socket says 172.21.15.52:42852) 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.667+0000 7fd48effd640 1 -- 172.21.15.52:0/3972268252 learned_addr learned my addr 172.21.15.52:0/3972268252 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd48effd640 1 -- 172.21.15.52:0/3972268252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4901225f0 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd48effd640 1 --2- 172.21.15.52:0/3972268252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 0x7fd490120f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd48000e040 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd480012b00 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd480012da0 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd490122830 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fd480015780 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd490122200 con 0x7fd49009cf20 2024-09-11T14:38:36.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.668+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fd480015cb0 con 0x7fd49009cf20 2024-09-11T14:38:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.669+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4901be5a0 con 0x7fd49009cf20 2024-09-11T14:38:36.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.671+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fd480014ba0 con 0x7fd49009cf20 2024-09-11T14:38:36.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:36.747+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fd49009d6e0 con 0x7fd49009cf20 2024-09-11T14:38:36.748 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-11T14:38:36.747+0000 7f2cad5f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-11T14:38:36.748 INFO:tasks.ceph.mon.a.smithi052.stderr:Please be aware that this feature is experimental, untested, 2024-09-11T14:38:36.748 INFO:tasks.ceph.mon.a.smithi052.stderr:unsupported, and may result in data corruption, data loss, 2024-09-11T14:38:36.748 INFO:tasks.ceph.mon.a.smithi052.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-11T14:38:36.749 INFO:tasks.ceph.mon.a.smithi052.stderr:feature with important data. 2024-09-11T14:38:36.749 INFO:tasks.ceph.mon.a.smithi052.stderr: 2024-09-11T14:38:37.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.537+0000 7fd4777fe640 1 -- 172.21.15.52:0/3972268252 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fd480014d40 con 0x7fd49009cf20 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 msgr2=0x7fd490120f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 --2- 172.21.15.52:0/3972268252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 0x7fd490120f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 shutdown_connections 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 --2- 172.21.15.52:0/3972268252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49009cf20 0x7fd490120f40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 >> 172.21.15.52:0/3972268252 conn(0x7fd4900a43e0 msgr2=0x7fd490072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 shutdown_connections 2024-09-11T14:38:37.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:37.539+0000 7fd4954fd640 1 -- 172.21.15.52:0/3972268252 wait complete. 2024-09-11T14:38:37.554 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T14:38:37.554 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:37.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T14:38:37.582 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:38:37.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T14:38:37.651 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:37.651 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T14:38:37.675 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-11T14:38:37.675 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T14:38:37.741 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new d2ba10be-8405-43e0-bf6c-00ee6c90d481 0 2024-09-11T14:38:37.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.881+0000 7f29818fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:37.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f29818fd640 1 Processor -- start 2024-09-11T14:38:37.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f29818fd640 1 -- start start 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f29818fd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f297c11d8e0 0x7f297c11fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f29818fd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c1202d0 con 0x7f297c1199a0 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f29818fd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f297c121490 con 0x7f297c11d8e0 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f297a7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f297c11d8e0 0x7f297c11fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f297a7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f297c11d8e0 0x7f297c11fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48548/0 (socket says 172.21.15.143:48548) 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f297affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f297c1199a0 0x7f297c119db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.143:40552/0 (socket says 172.21.15.143:40552) 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.888+0000 7f297a7fc640 1 -- 172.21.15.143:0/2472813101 learned_addr learned my addr 172.21.15.143:0/2472813101 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.889+0000 7f297a7fc640 1 -- 172.21.15.143:0/2472813101 >> v1:172.21.15.52:6789/0 conn(0x7f297c1199a0 legacy=0x7f297c119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.889+0000 7f297a7fc640 1 -- 172.21.15.143:0/2472813101 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c121600 con 0x7f297c11d8e0 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.889+0000 7f297a7fc640 1 --2- 172.21.15.143:0/2472813101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c11d8e0 0x7f297c11fd00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d824df5758febdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:37.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.889+0000 7f2979ffb640 1 -- 172.21.15.143:0/2472813101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2970009e50 con 0x7f297c11d8e0 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.889+0000 7f2979ffb640 1 -- 172.21.15.143:0/2472813101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f297000e230 con 0x7f297c11d8e0 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.889+0000 7f2979ffb640 1 -- 172.21.15.143:0/2472813101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f297000e4d0 con 0x7f297c11d8e0 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 -- 172.21.15.143:0/2472813101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c11d8e0 msgr2=0x7f297c11fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 --2- 172.21.15.143:0/2472813101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c11d8e0 0x7f297c11fd00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 -- 172.21.15.143:0/2472813101 shutdown_connections 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 --2- 172.21.15.143:0/2472813101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c11d8e0 0x7f297c11fd00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 -- 172.21.15.143:0/2472813101 >> 172.21.15.143:0/2472813101 conn(0x7f297c06fab0 msgr2=0x7f297c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 -- 172.21.15.143:0/2472813101 shutdown_connections 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 1 -- 172.21.15.143:0/2472813101 wait complete. 2024-09-11T14:38:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.890+0000 7f29818fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:37.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.891+0000 7f29818fd640 1 Processor -- start 2024-09-11T14:38:37.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.891+0000 7f29818fd640 1 -- start start 2024-09-11T14:38:37.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.891+0000 7f29818fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 0x7f297c1a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:37.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.891+0000 7f29818fd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f297c1a9e80 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f297affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 0x7f297c1a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f297affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 0x7f297c1a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48552/0 (socket says 172.21.15.143:48552) 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f297affd640 1 -- 172.21.15.143:0/1379518325 learned_addr learned my addr 172.21.15.143:0/1379518325 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f297affd640 1 -- 172.21.15.143:0/1379518325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c1a9fc0 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f297affd640 1 --2- 172.21.15.143:0/1379518325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 0x7f297c1a98b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f296c0059a0 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f296c005b00 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c1aa270 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f296c005da0 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.892+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c1af110 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.893+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f296c00cba0 con 0x7f297c1199a0 2024-09-11T14:38:37.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.893+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f296c00fa30 con 0x7f297c1199a0 2024-09-11T14:38:37.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.893+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c120f20 con 0x7f297c1199a0 2024-09-11T14:38:37.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.896+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f296c00fc90 con 0x7f297c1199a0 2024-09-11T14:38:37.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.968+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2ba10be-8405-43e0-bf6c-00ee6c90d481", "id": 0} v 0) -- 0x7f297c1207c0 con 0x7f297c1199a0 2024-09-11T14:38:37.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.969+0000 7f2963fff640 1 -- 172.21.15.143:0/1379518325 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2ba10be-8405-43e0-bf6c-00ee6c90d481", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f296c0070b0 con 0x7f297c1199a0 2024-09-11T14:38:37.971 INFO:teuthology.orchestra.run.smithi143.stdout:0 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 msgr2=0x7f297c1a98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 --2- 172.21.15.143:0/1379518325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 0x7f297c1a98b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 shutdown_connections 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 --2- 172.21.15.143:0/1379518325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f297c1199a0 0x7f297c1a98b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 >> 172.21.15.143:0/1379518325 conn(0x7f297c06fab0 msgr2=0x7f297c11b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 shutdown_connections 2024-09-11T14:38:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:37.970+0000 7f29818fd640 1 -- 172.21.15.143:0/1379518325 wait complete. 2024-09-11T14:38:37.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 88407485-bd36-46fd-9dcb-611a3f99f4fb 1 2024-09-11T14:38:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.082+0000 7f8f14d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.089+0000 7f8f14d91640 1 Processor -- start 2024-09-11T14:38:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.089+0000 7f8f14d91640 1 -- start start 2024-09-11T14:38:38.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f14d91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f101199a0 0x7f8f10119db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:38.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f14d91640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f10115870 con 0x7f8f10114d50 2024-09-11T14:38:38.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f14d91640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8f10115a00 con 0x7f8f101199a0 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f0e59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f101199a0 0x7f8f10119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f0e59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f101199a0 0x7f8f10119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48556/0 (socket says 172.21.15.143:48556) 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f0e59c640 1 -- 172.21.15.143:0/2658111132 learned_addr learned my addr 172.21.15.143:0/2658111132 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f0e59c640 1 -- 172.21.15.143:0/2658111132 >> v1:172.21.15.52:6789/0 conn(0x7f8f10114d50 legacy=0x7f8f10115160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f0e59c640 1 -- 172.21.15.143:0/2658111132 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f10115b70 con 0x7f8f101199a0 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.090+0000 7f8f0e59c640 1 --2- 172.21.15.143:0/2658111132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f101199a0 0x7f8f10119db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a31db4ef5b92bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.091+0000 7f8f0dd9b640 1 -- 172.21.15.143:0/2658111132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f00009e50 con 0x7f8f101199a0 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.091+0000 7f8f0dd9b640 1 -- 172.21.15.143:0/2658111132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8f0000e230 con 0x7f8f101199a0 2024-09-11T14:38:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.091+0000 7f8f0dd9b640 1 -- 172.21.15.143:0/2658111132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f0000e4d0 con 0x7f8f101199a0 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.091+0000 7f8f14d91640 1 -- 172.21.15.143:0/2658111132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f101199a0 msgr2=0x7f8f10119db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.091+0000 7f8f14d91640 1 --2- 172.21.15.143:0/2658111132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f101199a0 0x7f8f10119db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.091+0000 7f8f14d91640 1 -- 172.21.15.143:0/2658111132 shutdown_connections 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.092+0000 7f8f14d91640 1 --2- 172.21.15.143:0/2658111132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f101199a0 0x7f8f10119db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.092+0000 7f8f14d91640 1 -- 172.21.15.143:0/2658111132 >> 172.21.15.143:0/2658111132 conn(0x7f8f1006fab0 msgr2=0x7f8f1006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.092+0000 7f8f14d91640 1 -- 172.21.15.143:0/2658111132 shutdown_connections 2024-09-11T14:38:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.092+0000 7f8f14d91640 1 -- 172.21.15.143:0/2658111132 wait complete. 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.092+0000 7f8f14d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.093+0000 7f8f14d91640 1 Processor -- start 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.093+0000 7f8f14d91640 1 -- start start 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.093+0000 7f8f14d91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 0x7f8f101a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.093+0000 7f8f14d91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101a9e80 con 0x7f8f10114d50 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.094+0000 7f8f0e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 0x7f8f101a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.094+0000 7f8f0e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 0x7f8f101a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48568/0 (socket says 172.21.15.143:48568) 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.094+0000 7f8f0e59c640 1 -- 172.21.15.143:0/2652956944 learned_addr learned my addr 172.21.15.143:0/2652956944 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.094+0000 7f8f0e59c640 1 -- 172.21.15.143:0/2652956944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f101a9fc0 con 0x7f8f10114d50 2024-09-11T14:38:38.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.095+0000 7f8f0e59c640 1 --2- 172.21.15.143:0/2652956944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 0x7f8f101a98b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.095+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f0000eea0 con 0x7f8f10114d50 2024-09-11T14:38:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.096+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f101aa210 con 0x7f8f10114d50 2024-09-11T14:38:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.096+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8f00015420 con 0x7f8f10114d50 2024-09-11T14:38:38.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.096+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f00015710 con 0x7f8f10114d50 2024-09-11T14:38:38.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.096+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f101af110 con 0x7f8f10114d50 2024-09-11T14:38:38.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.096+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8f00015c00 con 0x7f8f10114d50 2024-09-11T14:38:38.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.096+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f8f00011740 con 0x7f8f10114d50 2024-09-11T14:38:38.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.097+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f10120ba0 con 0x7f8f10114d50 2024-09-11T14:38:38.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.100+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8f000119a0 con 0x7f8f10114d50 2024-09-11T14:38:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.169+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88407485-bd36-46fd-9dcb-611a3f99f4fb", "id": 1} v 0) -- 0x7f8f10120da0 con 0x7f8f10114d50 2024-09-11T14:38:38.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.171+0000 7f8f077fe640 1 -- 172.21.15.143:0/2652956944 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88407485-bd36-46fd-9dcb-611a3f99f4fb", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f8f00011bc0 con 0x7f8f10114d50 2024-09-11T14:38:38.173 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-09-11T14:38:38.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 msgr2=0x7f8f101a98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 --2- 172.21.15.143:0/2652956944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 0x7f8f101a98b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 shutdown_connections 2024-09-11T14:38:38.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 --2- 172.21.15.143:0/2652956944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f10114d50 0x7f8f101a98b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 >> 172.21.15.143:0/2652956944 conn(0x7f8f1006fab0 msgr2=0x7f8f10113d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:38.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 shutdown_connections 2024-09-11T14:38:38.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.172+0000 7f8f14d91640 1 -- 172.21.15.143:0/2652956944 wait complete. 2024-09-11T14:38:38.185 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 46f85cbf-34b9-4cf9-9cb7-6390b1b37448 2 2024-09-11T14:38:38.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.283+0000 7f1411d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.290+0000 7f1411d91640 1 Processor -- start 2024-09-11T14:38:38.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.290+0000 7f1411d91640 1 -- start start 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.290+0000 7f1411d91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f140c11d8e0 0x7f140c11fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.290+0000 7f1411d91640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140c1202d0 con 0x7f140c1199a0 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.290+0000 7f1411d91640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f140c121490 con 0x7f140c11d8e0 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f140c11d8e0 0x7f140c11fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140b7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f140c1199a0 0x7f140c119db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.143:40572/0 (socket says 172.21.15.143:40572) 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f140c11d8e0 0x7f140c11fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48582/0 (socket says 172.21.15.143:48582) 2024-09-11T14:38:38.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140b7fe640 1 -- 172.21.15.143:0/3770263792 learned_addr learned my addr 172.21.15.143:0/3770263792 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140affd640 1 -- 172.21.15.143:0/3770263792 >> v1:172.21.15.52:6789/0 conn(0x7f140c1199a0 legacy=0x7f140c119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140a7fc640 1 -- 172.21.15.143:0/3770263792 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594908251 0 0) 0x7f140c1202d0 con 0x7f140c1199a0 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140affd640 1 -- 172.21.15.143:0/3770263792 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c121600 con 0x7f140c11d8e0 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.291+0000 7f140affd640 1 --2- 172.21.15.143:0/3770263792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c11d8e0 0x7f140c11fd00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f78f9b5c0fe5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f140a7fc640 1 -- 172.21.15.143:0/3770263792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1400009d90 con 0x7f140c11d8e0 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f140a7fc640 1 -- 172.21.15.143:0/3770263792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f140000e230 con 0x7f140c11d8e0 2024-09-11T14:38:38.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f140a7fc640 1 -- 172.21.15.143:0/3770263792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f140000e4d0 con 0x7f140c11d8e0 2024-09-11T14:38:38.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 -- 172.21.15.143:0/3770263792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c11d8e0 msgr2=0x7f140c11fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 --2- 172.21.15.143:0/3770263792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c11d8e0 0x7f140c11fd00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 -- 172.21.15.143:0/3770263792 shutdown_connections 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 --2- 172.21.15.143:0/3770263792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c11d8e0 0x7f140c11fd00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 -- 172.21.15.143:0/3770263792 >> 172.21.15.143:0/3770263792 conn(0x7f140c06fab0 msgr2=0x7f140c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 -- 172.21.15.143:0/3770263792 shutdown_connections 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.292+0000 7f1411d91640 1 -- 172.21.15.143:0/3770263792 wait complete. 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.293+0000 7f1411d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.293+0000 7f1411d91640 1 Processor -- start 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f1411d91640 1 -- start start 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f1411d91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 0x7f140c1a9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f1411d91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f140c1a9d60 con 0x7f140c1199a0 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f140b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 0x7f140c1a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f140b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 0x7f140c1a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48586/0 (socket says 172.21.15.143:48586) 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f140b7fe640 1 -- 172.21.15.143:0/5946814 learned_addr learned my addr 172.21.15.143:0/5946814 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.294+0000 7f140b7fe640 1 -- 172.21.15.143:0/5946814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c1a9ea0 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f140b7fe640 1 --2- 172.21.15.143:0/5946814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 0x7f140c1a9790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13fc004c60 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f13fc004dc0 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c1aa150 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13fc007250 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c1aeff0 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f13fc00c660 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.295+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f13fc00cd50 con 0x7f140c1199a0 2024-09-11T14:38:38.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.296+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c120f40 con 0x7f140c1199a0 2024-09-11T14:38:38.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.298+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f13fc00f230 con 0x7f140c1199a0 2024-09-11T14:38:38.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.368+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46f85cbf-34b9-4cf9-9cb7-6390b1b37448", "id": 2} v 0) -- 0x7f140c1207c0 con 0x7f140c1199a0 2024-09-11T14:38:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.369+0000 7f13f3fff640 1 -- 172.21.15.143:0/5946814 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46f85cbf-34b9-4cf9-9cb7-6390b1b37448", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f13fc00f3d0 con 0x7f140c1199a0 2024-09-11T14:38:38.372 INFO:teuthology.orchestra.run.smithi143.stdout:2 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.370+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 msgr2=0x7f140c1a9790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.370+0000 7f1411d91640 1 --2- 172.21.15.143:0/5946814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 0x7f140c1a9790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.370+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 shutdown_connections 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.370+0000 7f1411d91640 1 --2- 172.21.15.143:0/5946814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f140c1199a0 0x7f140c1a9790 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.370+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 >> 172.21.15.143:0/5946814 conn(0x7f140c06fab0 msgr2=0x7f140c11b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.370+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 shutdown_connections 2024-09-11T14:38:38.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.371+0000 7f1411d91640 1 -- 172.21.15.143:0/5946814 wait complete. 2024-09-11T14:38:38.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 578c9a69-f18b-4318-9428-c582ab58eb18 3 2024-09-11T14:38:38.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.484+0000 7f1466e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.490+0000 7f1466e63640 1 Processor -- start 2024-09-11T14:38:38.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f1466e63640 1 -- start start 2024-09-11T14:38:38.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f1466e63640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f146011d8e0 0x7f146011fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:38.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f1466e63640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14601202d0 con 0x7f14601199a0 2024-09-11T14:38:38.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f1466e63640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1460121490 con 0x7f146011d8e0 2024-09-11T14:38:38.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f145ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f146011d8e0 0x7f146011fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:38.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f145ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f146011d8e0 0x7f146011fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48590/0 (socket says 172.21.15.143:48590) 2024-09-11T14:38:38.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.491+0000 7f145ffff640 1 -- 172.21.15.143:0/922555974 learned_addr learned my addr 172.21.15.143:0/922555974 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.492+0000 7f145ffff640 1 -- 172.21.15.143:0/922555974 >> v1:172.21.15.52:6789/0 conn(0x7f14601199a0 legacy=0x7f1460119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.492+0000 7f145ffff640 1 -- 172.21.15.143:0/922555974 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1460121600 con 0x7f146011d8e0 2024-09-11T14:38:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.492+0000 7f145ffff640 1 --2- 172.21.15.143:0/922555974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f146011d8e0 0x7f146011fd00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed54a4d0eaf915f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.492+0000 7f145f7fe640 1 -- 172.21.15.143:0/922555974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f144c009e50 con 0x7f146011d8e0 2024-09-11T14:38:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.492+0000 7f145f7fe640 1 -- 172.21.15.143:0/922555974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f144c00e230 con 0x7f146011d8e0 2024-09-11T14:38:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.492+0000 7f145f7fe640 1 -- 172.21.15.143:0/922555974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f144c00e4d0 con 0x7f146011d8e0 2024-09-11T14:38:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 -- 172.21.15.143:0/922555974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f146011d8e0 msgr2=0x7f146011fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 --2- 172.21.15.143:0/922555974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f146011d8e0 0x7f146011fd00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 -- 172.21.15.143:0/922555974 shutdown_connections 2024-09-11T14:38:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 --2- 172.21.15.143:0/922555974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f146011d8e0 0x7f146011fd00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 -- 172.21.15.143:0/922555974 >> 172.21.15.143:0/922555974 conn(0x7f146006fab0 msgr2=0x7f146006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:38.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 -- 172.21.15.143:0/922555974 shutdown_connections 2024-09-11T14:38:38.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 1 -- 172.21.15.143:0/922555974 wait complete. 2024-09-11T14:38:38.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.493+0000 7f1466e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:38.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.494+0000 7f1466e63640 1 Processor -- start 2024-09-11T14:38:38.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.494+0000 7f1466e63640 1 -- start start 2024-09-11T14:38:38.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1466e63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 0x7f14601a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1466e63640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14601a9e80 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1464bff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 0x7f14601a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1464bff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 0x7f14601a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.143:48606/0 (socket says 172.21.15.143:48606) 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1464bff640 1 -- 172.21.15.143:0/1381138797 learned_addr learned my addr 172.21.15.143:0/1381138797 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1464bff640 1 -- 172.21.15.143:0/1381138797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14601a9fc0 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.495+0000 7f1464bff640 1 --2- 172.21.15.143:0/1381138797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 0x7f14601a98b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f145400c950 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f145400cab0 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14601aa270 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f145400cd50 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14601af110 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f14540116a0 con 0x7f14601199a0 2024-09-11T14:38:38.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.496+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f1454010a70 con 0x7f14601199a0 2024-09-11T14:38:38.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.497+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1460120f20 con 0x7f14601199a0 2024-09-11T14:38:38.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.499+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f1454010cd0 con 0x7f14601199a0 2024-09-11T14:38:38.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.570+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "578c9a69-f18b-4318-9428-c582ab58eb18", "id": 3} v 0) -- 0x7f14601207c0 con 0x7f14601199a0 2024-09-11T14:38:38.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.571+0000 7f145d7fa640 1 -- 172.21.15.143:0/1381138797 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "578c9a69-f18b-4318-9428-c582ab58eb18", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f1454010e70 con 0x7f14601199a0 2024-09-11T14:38:38.573 INFO:teuthology.orchestra.run.smithi143.stdout:3 2024-09-11T14:38:38.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 msgr2=0x7f14601a98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:38.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 --2- 172.21.15.143:0/1381138797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 0x7f14601a98b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 shutdown_connections 2024-09-11T14:38:38.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 --2- 172.21.15.143:0/1381138797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14601199a0 0x7f14601a98b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:38.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 >> 172.21.15.143:0/1381138797 conn(0x7f146006fab0 msgr2=0x7f146011b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:38.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 shutdown_connections 2024-09-11T14:38:38.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-11T14:38:38.572+0000 7f1466e63640 1 -- 172.21.15.143:0/1381138797 wait complete. 2024-09-11T14:38:38.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-11T14:38:38.625 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T14:38:38.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-11T14:38:38.669 INFO:tasks.ceph.osd.0:Started 2024-09-11T14:38:38.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-11T14:38:38.703 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T14:38:38.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-11T14:38:38.746 INFO:tasks.ceph.osd.1:Started 2024-09-11T14:38:38.746 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-11T14:38:38.777 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T14:38:38.777 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-11T14:38:38.820 INFO:tasks.ceph.osd.2:Started 2024-09-11T14:38:38.820 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-11T14:38:38.849 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T14:38:38.849 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-11T14:38:38.891 INFO:tasks.ceph.osd.3:Started 2024-09-11T14:38:38.892 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:38:39.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.010+0000 7fb8ea511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:39.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.015+0000 7fb8ea511640 1 Processor -- start 2024-09-11T14:38:39.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.016+0000 7fb8ea511640 1 -- start start 2024-09-11T14:38:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.017+0000 7fb8ea511640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8e40a3e10 0x7fb8e40a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.017+0000 7fb8ea511640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e406ec50 con 0x7fb8e40a4760 2024-09-11T14:38:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.017+0000 7fb8ea511640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e40a6130 con 0x7fb8e40a3e10 2024-09-11T14:38:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.017+0000 7fb8e3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8e40a3e10 0x7fb8e40a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.017+0000 7fb8e37fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb8e40a4760 0x7fb8e4135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46044/0 (socket says 172.21.15.52:46044) 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.017+0000 7fb8e37fe640 1 -- 172.21.15.52:0/2851330072 learned_addr learned my addr 172.21.15.52:0/2851330072 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e3fff640 1 -- 172.21.15.52:0/2851330072 >> v1:172.21.15.52:6789/0 conn(0x7fb8e40a4760 legacy=0x7fb8e4135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e3fff640 1 -- 172.21.15.52:0/2851330072 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e40a5110 con 0x7fb8e40a3e10 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e2ffd640 1 -- 172.21.15.52:0/2851330072 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082064162 0 0) 0x7fb8e406ec50 con 0x7fb8e40a4760 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e3fff640 1 --2- 172.21.15.52:0/2851330072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e40a4220 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c60dfc886850ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e2ffd640 1 -- 172.21.15.52:0/2851330072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d4009d90 con 0x7fb8e40a3e10 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e2ffd640 1 -- 172.21.15.52:0/2851330072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb8d400e230 con 0x7fb8e40a3e10 2024-09-11T14:38:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.018+0000 7fb8e2ffd640 1 -- 172.21.15.52:0/2851330072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d400e4d0 con 0x7fb8e40a3e10 2024-09-11T14:38:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 -- 172.21.15.52:0/2851330072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 msgr2=0x7fb8e40a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 --2- 172.21.15.52:0/2851330072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e40a4220 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 -- 172.21.15.52:0/2851330072 shutdown_connections 2024-09-11T14:38:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 --2- 172.21.15.52:0/2851330072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e40a4220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 -- 172.21.15.52:0/2851330072 >> 172.21.15.52:0/2851330072 conn(0x7fb8e40a74f0 msgr2=0x7fb8e40a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 -- 172.21.15.52:0/2851330072 shutdown_connections 2024-09-11T14:38:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 1 -- 172.21.15.52:0/2851330072 wait complete. 2024-09-11T14:38:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.019+0000 7fb8ea511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.021+0000 7fb8ea511640 1 Processor -- start 2024-09-11T14:38:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.021+0000 7fb8ea511640 1 -- start start 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8ea511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e4123df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8ea511640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e4126070 con 0x7fb8e40a3e10 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e4123df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e4123df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42880/0 (socket says 172.21.15.52:42880) 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1536580401 learned_addr learned my addr 172.21.15.52:0/1536580401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1536580401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e41251c0 con 0x7fb8e40a3e10 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e3fff640 1 --2- 172.21.15.52:0/1536580401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e4123df0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d4013610 con 0x7fb8e40a3e10 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb8d4013770 con 0x7fb8e40a3e10 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.023+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e4123780 con 0x7fb8e40a3e10 2024-09-11T14:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.024+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8d4013a10 con 0x7fb8e40a3e10 2024-09-11T14:38:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.024+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e4123a50 con 0x7fb8e40a3e10 2024-09-11T14:38:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.024+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fb8d40123f0 con 0x7fb8e40a3e10 2024-09-11T14:38:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.024+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7fb8d4018040 con 0x7fb8e40a3e10 2024-09-11T14:38:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.024+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e4125ae0 con 0x7fb8e40a3e10 2024-09-11T14:38:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.027+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fb8d4011bc0 con 0x7fb8e40a3e10 2024-09-11T14:38:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.089+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8e40a56d0 con 0x7fb8e40a3e10 2024-09-11T14:38:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.089+0000 7fb8e0ff9640 1 -- 172.21.15.52:0/1536580401 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7fb8d4011d60 con 0x7fb8e40a3e10 2024-09-11T14:38:39.091 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:39.091 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":7,"fsid":"a6b5d4a4-66d9-4a76-9e4a-eb916006be26","created":"2024-09-11T14:38:36.445816+0000","modified":"2024-09-11T14:38:38.572455+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:38:38.572455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d2ba10be-8405-43e0-bf6c-00ee6c90d481","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88407485-bd36-46fd-9dcb-611a3f99f4fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46f85cbf-34b9-4cf9-9cb7-6390b1b37448","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"578c9a69-f18b-4318-9428-c582ab58eb18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 msgr2=0x7fb8e4123df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 --2- 172.21.15.52:0/1536580401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e4123df0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 shutdown_connections 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 --2- 172.21.15.52:0/1536580401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8e40a3e10 0x7fb8e4123df0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 >> 172.21.15.52:0/1536580401 conn(0x7fb8e40a74f0 msgr2=0x7fb8e40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 shutdown_connections 2024-09-11T14:38:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:39.090+0000 7fb8ea511640 1 -- 172.21.15.52:0/1536580401 wait complete. 2024-09-11T14:38:39.103 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T14:38:39.103 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T14:38:39.506 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:38:39.613 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.608+0000 7f69d7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:39.614 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.614+0000 7f69d7391640 1 Processor -- start 2024-09-11T14:38:39.615 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.614+0000 7f69d7391640 1 -- start start 2024-09-11T14:38:39.617 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.615+0000 7f69d7391640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69d00a4930 0x7f69d013b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:39.617 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.615+0000 7f69d7391640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d006ed80 con 0x7f69d00a3e10 2024-09-11T14:38:39.617 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.615+0000 7f69d7391640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f69d00a6380 con 0x7f69d00a4930 2024-09-11T14:38:39.617 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.615+0000 7f69d492c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69d00a4930 0x7f69d013b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:39.617 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.615+0000 7f69d512d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f69d00a3e10 0x7f69d00a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46058/0 (socket says 172.21.15.52:46058) 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.615+0000 7f69d512d640 1 -- 172.21.15.52:0/1300674200 learned_addr learned my addr 172.21.15.52:0/1300674200 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69d492c640 1 -- 172.21.15.52:0/1300674200 >> v1:172.21.15.52:6789/0 conn(0x7f69d00a3e10 legacy=0x7f69d00a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69c7fff640 1 -- 172.21.15.52:0/1300674200 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298883401 0 0) 0x7f69d006ed80 con 0x7f69d00a3e10 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69d492c640 1 -- 172.21.15.52:0/1300674200 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d006f7a0 con 0x7f69d00a4930 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69d492c640 1 --2- 172.21.15.52:0/1300674200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a4930 0x7f69d013b4e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac50295b545884e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69c7fff640 1 -- 172.21.15.52:0/1300674200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69c0009d90 con 0x7f69d00a4930 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69c7fff640 1 -- 172.21.15.52:0/1300674200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f69c000e230 con 0x7f69d00a4930 2024-09-11T14:38:39.618 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.616+0000 7f69c7fff640 1 -- 172.21.15.52:0/1300674200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69c000e4d0 con 0x7f69d00a4930 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 -- 172.21.15.52:0/1300674200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a4930 msgr2=0x7f69d013b4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 --2- 172.21.15.52:0/1300674200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a4930 0x7f69d013b4e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 -- 172.21.15.52:0/1300674200 shutdown_connections 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 --2- 172.21.15.52:0/1300674200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a4930 0x7f69d013b4e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 -- 172.21.15.52:0/1300674200 >> 172.21.15.52:0/1300674200 conn(0x7f69d00a7700 msgr2=0x7f69d00a7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 -- 172.21.15.52:0/1300674200 shutdown_connections 2024-09-11T14:38:39.619 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.617+0000 7f69d7391640 1 -- 172.21.15.52:0/1300674200 wait complete. 2024-09-11T14:38:39.620 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.618+0000 7f69d7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:39.620 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.619+0000 7f69d7391640 1 Processor -- start 2024-09-11T14:38:39.620 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.619+0000 7f69d7391640 1 -- start start 2024-09-11T14:38:39.623 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.621+0000 7f69d7391640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 0x7f69d0126d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:39.623 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.621+0000 7f69d7391640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0136f70 con 0x7f69d00a3e10 2024-09-11T14:38:39.623 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.621+0000 7f69d512d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 0x7f69d0126d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:39.623 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.621+0000 7f69d512d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 0x7f69d0126d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42892/0 (socket says 172.21.15.52:42892) 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.621+0000 7f69d512d640 1 -- 172.21.15.52:0/298280967 learned_addr learned my addr 172.21.15.52:0/298280967 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69d512d640 1 -- 172.21.15.52:0/298280967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d0125610 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69d512d640 1 --2- 172.21.15.52:0/298280967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 0x7f69d0126d50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69cc004b80 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f69cc004ce0 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d0124d60 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69cc007120 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f69cc00c520 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d0126430 con 0x7f69d00a3e10 2024-09-11T14:38:39.624 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.622+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f69cc007660 con 0x7f69d00a3e10 2024-09-11T14:38:39.625 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.623+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d01be0c0 con 0x7f69d00a3e10 2024-09-11T14:38:39.628 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.627+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f69d01be0c0 con 0x7f69d00a3e10 2024-09-11T14:38:39.691 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.690+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69d006f320 con 0x7f69d00a3e10 2024-09-11T14:38:39.691 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.691+0000 7f69c5ffb640 1 -- 172.21.15.52:0/298280967 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f69cc00e270 con 0x7f69d00a3e10 2024-09-11T14:38:39.692 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-11T14:38:39.692 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":7,"fsid":"a6b5d4a4-66d9-4a76-9e4a-eb916006be26","created":"2024-09-11T14:38:36.445816+0000","modified":"2024-09-11T14:38:38.572455+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:38:38.572455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"d2ba10be-8405-43e0-bf6c-00ee6c90d481","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"88407485-bd36-46fd-9dcb-611a3f99f4fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46f85cbf-34b9-4cf9-9cb7-6390b1b37448","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"578c9a69-f18b-4318-9428-c582ab58eb18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.691+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 msgr2=0x7f69d0126d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.691+0000 7f69d7391640 1 --2- 172.21.15.52:0/298280967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 0x7f69d0126d50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.692+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 shutdown_connections 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.692+0000 7f69d7391640 1 --2- 172.21.15.52:0/298280967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69d00a3e10 0x7f69d0126d50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.692+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 >> 172.21.15.52:0/298280967 conn(0x7f69d00a7700 msgr2=0x7f69d01bc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.692+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 shutdown_connections 2024-09-11T14:38:39.693 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:39.692+0000 7f69d7391640 1 -- 172.21.15.52:0/298280967 wait complete. 2024-09-11T14:38:39.702 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-11T14:38:41.916 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-09-11T14:38:41.915+0000 7faa53a49640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T14:38:46.106 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:38:46.213 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.208+0000 7fdce4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:46.214 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.213+0000 7fdce4f91640 1 Processor -- start 2024-09-11T14:38:46.214 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.213+0000 7fdce4f91640 1 -- start start 2024-09-11T14:38:46.216 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdce4f91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdce009b490 0x7fdce009b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdce4f91640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce00737e0 con 0x7fdce0072120 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdce4f91640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdce0050fc0 con 0x7fdce009b490 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdcde59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdce009b490 0x7fdce009b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdcddd9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdce0072120 0x7fdce0072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47996/0 (socket says 172.21.15.52:47996) 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdcddd9b640 1 -- 172.21.15.52:0/2538851781 learned_addr learned my addr 172.21.15.52:0/2538851781 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.215+0000 7fdcde59c640 1 -- 172.21.15.52:0/2538851781 >> v1:172.21.15.52:6789/0 conn(0x7fdce0072120 legacy=0x7fdce0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.216+0000 7fdcde59c640 1 -- 172.21.15.52:0/2538851781 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce00734e0 con 0x7fdce009b490 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.216+0000 7fdcdd59a640 1 -- 172.21.15.52:0/2538851781 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559891554 0 0) 0x7fdce00737e0 con 0x7fdce0072120 2024-09-11T14:38:46.217 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.216+0000 7fdcde59c640 1 --2- 172.21.15.52:0/2538851781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce009b490 0x7fdce009b8a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea309d5c92cceb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:46.218 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.216+0000 7fdcdd59a640 1 -- 172.21.15.52:0/2538851781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcd000e040 con 0x7fdce009b490 2024-09-11T14:38:46.218 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.216+0000 7fdcdd59a640 1 -- 172.21.15.52:0/2538851781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdcd0007670 con 0x7fdce009b490 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.216+0000 7fdcdd59a640 1 -- 172.21.15.52:0/2538851781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcd0007910 con 0x7fdce009b490 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 -- 172.21.15.52:0/2538851781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce009b490 msgr2=0x7fdce009b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 --2- 172.21.15.52:0/2538851781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce009b490 0x7fdce009b8a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 -- 172.21.15.52:0/2538851781 shutdown_connections 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 --2- 172.21.15.52:0/2538851781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce009b490 0x7fdce009b8a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 -- 172.21.15.52:0/2538851781 >> 172.21.15.52:0/2538851781 conn(0x7fdce00a2b50 msgr2=0x7fdce00a2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 -- 172.21.15.52:0/2538851781 shutdown_connections 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 1 -- 172.21.15.52:0/2538851781 wait complete. 2024-09-11T14:38:46.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.217+0000 7fdce4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:46.220 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.219+0000 7fdce4f91640 1 Processor -- start 2024-09-11T14:38:46.220 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.219+0000 7fdce4f91640 1 -- start start 2024-09-11T14:38:46.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.220+0000 7fdce4f91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 0x7fdce012e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:46.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.220+0000 7fdce4f91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdce009e730 con 0x7fdce0072120 2024-09-11T14:38:46.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.220+0000 7fdcde59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 0x7fdce012e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:46.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcde59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 0x7fdce012e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40220/0 (socket says 172.21.15.52:40220) 2024-09-11T14:38:46.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcde59c640 1 -- 172.21.15.52:0/2025284018 learned_addr learned my addr 172.21.15.52:0/2025284018 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcde59c640 1 -- 172.21.15.52:0/2025284018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce0131340 con 0x7fdce0072120 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcde59c640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 0x7fdce012e1d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcd000e040 con 0x7fdce0072120 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdcd00139f0 con 0x7fdce0072120 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcd0013c90 con 0x7fdce0072120 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce012faa0 con 0x7fdce0072120 2024-09-11T14:38:46.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.221+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce0131bd0 con 0x7fdce0072120 2024-09-11T14:38:46.224 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.222+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce009c5f0 con 0x7fdce0072120 2024-09-11T14:38:46.224 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.222+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fdcd0011040 con 0x7fdce0072120 2024-09-11T14:38:46.224 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.223+0000 7fdcceffd640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdcc003e850 0x7fdcc0040d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:46.224 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.223+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 2308+0+0 (crc 0 0 0) 0x7fdcd0050d90 con 0x7fdce0072120 2024-09-11T14:38:46.224 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.223+0000 7fdcddd9b640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdcc003e850 0x7fdcc0040d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:46.225 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.224+0000 7fdcddd9b640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdcc003e850 0x7fdcc0040d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:46.229 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.228+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fdcd0015580 con 0x7fdce0072120 2024-09-11T14:38:46.415 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.414+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdce00a4980 con 0x7fdce0072120 2024-09-11T14:38:46.416 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.414+0000 7fdcceffd640 1 -- 172.21.15.52:0/2025284018 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+6962 (crc 0 0 0) 0x7fdcd000f210 con 0x7fdce0072120 2024-09-11T14:38:46.416 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-11T14:38:46.416 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"a6b5d4a4-66d9-4a76-9e4a-eb916006be26","created":"2024-09-11T14:38:36.445816+0000","modified":"2024-09-11T14:38:45.555142+0000","last_up_change":"2024-09-11T14:38:43.548076+0000","last_in_change":"2024-09-11T14:38:38.572455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:38:44.937773+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2ba10be-8405-43e0-bf6c-00ee6c90d481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6807","nonce":1907008724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1907008724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1907008724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1907008724}]},"public_addr":"172.21.15.52:6807/1907008724","cluster_addr":"172.21.15.52:6806/1907008724","heartbeat_back_addr":"172.21.15.52:6808/1907008724","heartbeat_front_addr":"172.21.15.52:6800/1907008724","state":["exists","up"]},{"osd":1,"uuid":"88407485-bd36-46fd-9dcb-611a3f99f4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4284075780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6801","nonce":4284075780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6805","nonce":4284075780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":4284075780}]},"public_addr":"172.21.15.52:6802/4284075780","cluster_addr":"172.21.15.52:6801/4284075780","heartbeat_back_addr":"172.21.15.52:6805/4284075780","heartbeat_front_addr":"172.21.15.52:6804/4284075780","state":["exists","up"]},{"osd":2,"uuid":"46f85cbf-34b9-4cf9-9cb7-6390b1b37448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2099775818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6809","nonce":2099775818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2099775818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":2099775818}]},"public_addr":"172.21.15.143:6808/2099775818","cluster_addr":"172.21.15.143:6809/2099775818","heartbeat_back_addr":"172.21.15.143:6820/2099775818","heartbeat_front_addr":"172.21.15.143:6819/2099775818","state":["exists","up"]},{"osd":3,"uuid":"578c9a69-f18b-4318-9428-c582ab58eb18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6803","nonce":3147275988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3147275988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3147275988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":3147275988}]},"public_addr":"172.21.15.143:6803/3147275988","cluster_addr":"172.21.15.143:6802/3147275988","heartbeat_back_addr":"172.21.15.143:6810/3147275988","heartbeat_front_addr":"172.21.15.143:6807/3147275988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:38:46.418 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdcc003e850 msgr2=0x7fdcc0040d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:46.418 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdcc003e850 0x7fdcc0040d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.418 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 msgr2=0x7fdce012e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:46.418 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 0x7fdce012e1d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.419 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 shutdown_connections 2024-09-11T14:38:46.419 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdcc003e850 0x7fdcc0040d60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.419 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 --2- 172.21.15.52:0/2025284018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce0072120 0x7fdce012e1d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.419 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 >> 172.21.15.52:0/2025284018 conn(0x7fdce00a2b50 msgr2=0x7fdce009f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:46.419 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 shutdown_connections 2024-09-11T14:38:46.419 INFO:teuthology.misc.health.smithi052.stderr:2024-09-11T14:38:46.417+0000 7fdce4f91640 1 -- 172.21.15.52:0/2025284018 wait complete. 2024-09-11T14:38:46.427 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-11T14:38:46.428 INFO:tasks.ceph:Creating RBD pool 2024-09-11T14:38:46.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T14:38:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.532+0000 7fb992f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.541+0000 7fb992f51640 1 Processor -- start 2024-09-11T14:38:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.541+0000 7fb992f51640 1 -- start start 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.542+0000 7fb992f51640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb98c073720 0x7fb98c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.542+0000 7fb992f51640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb98c0743d0 con 0x7fb98c0a1fc0 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.542+0000 7fb992f51640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb98c0740c0 con 0x7fb98c073720 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb98c073720 0x7fb98c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb990ced640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb98c0a1fc0 0x7fb98c073010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47998/0 (socket says 172.21.15.52:47998) 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb98c073720 0x7fb98c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40234/0 (socket says 172.21.15.52:40234) 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb990ced640 1 -- 172.21.15.52:0/3623420038 learned_addr learned my addr 172.21.15.52:0/3623420038 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98bfff640 1 -- 172.21.15.52:0/3623420038 >> v1:172.21.15.52:6789/0 conn(0x7fb98c0a1fc0 legacy=0x7fb98c073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98bfff640 1 -- 172.21.15.52:0/3623420038 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c0a3270 con 0x7fb98c073720 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98b7fe640 1 -- 172.21.15.52:0/3623420038 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154185781 0 0) 0x7fb98c0743d0 con 0x7fb98c0a1fc0 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98bfff640 1 --2- 172.21.15.52:0/3623420038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c13b160 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369e18062fff00b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98b7fe640 1 -- 172.21.15.52:0/3623420038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb978009d90 con 0x7fb98c073720 2024-09-11T14:38:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98b7fe640 1 -- 172.21.15.52:0/3623420038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb97800e230 con 0x7fb98c073720 2024-09-11T14:38:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.543+0000 7fb98b7fe640 1 -- 172.21.15.52:0/3623420038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb97800e4d0 con 0x7fb98c073720 2024-09-11T14:38:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 -- 172.21.15.52:0/3623420038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 msgr2=0x7fb98c13b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 --2- 172.21.15.52:0/3623420038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c13b160 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 -- 172.21.15.52:0/3623420038 shutdown_connections 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 --2- 172.21.15.52:0/3623420038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c13b160 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 -- 172.21.15.52:0/3623420038 >> 172.21.15.52:0/3623420038 conn(0x7fb98c06f0a0 msgr2=0x7fb98c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 -- 172.21.15.52:0/3623420038 shutdown_connections 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 1 -- 172.21.15.52:0/3623420038 wait complete. 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.544+0000 7fb992f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.546+0000 7fb992f51640 1 Processor -- start 2024-09-11T14:38:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.546+0000 7fb992f51640 1 -- start start 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb992f51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c1ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb992f51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c122ba0 con 0x7fb98c073720 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb990ced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c1ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb990ced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c1ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40244/0 (socket says 172.21.15.52:40244) 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb990ced640 1 -- 172.21.15.52:0/2515228169 learned_addr learned my addr 172.21.15.52:0/2515228169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb990ced640 1 -- 172.21.15.52:0/2515228169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c126740 con 0x7fb98c073720 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb990ced640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c1ca740 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.548+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb980004b80 con 0x7fb98c073720 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.549+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb980004ce0 con 0x7fb98c073720 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.549+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c1241e0 con 0x7fb98c073720 2024-09-11T14:38:46.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.549+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb980007120 con 0x7fb98c073720 2024-09-11T14:38:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.549+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c124a90 con 0x7fb98c073720 2024-09-11T14:38:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.549+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c073010 con 0x7fb98c073720 2024-09-11T14:38:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.550+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fb9800072d0 con 0x7fb98c073720 2024-09-11T14:38:46.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.550+0000 7fb9897fa640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb97003e8a0 0x7fb970040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.550+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 2308+0+0 (crc 0 0 0) 0x7fb98004f520 con 0x7fb98c073720 2024-09-11T14:38:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.550+0000 7fb98bfff640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb97003e8a0 0x7fb970040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:46.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.551+0000 7fb98bfff640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb97003e8a0 0x7fb970040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:46.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.555+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb98000f230 con 0x7fb98c073720 2024-09-11T14:38:46.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:46.773+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fb98c1bdcd0 con 0x7fb98c073720 2024-09-11T14:38:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.565+0000 7fb9897fa640 1 -- 172.21.15.52:0/2515228169 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7fb98000a0c0 con 0x7fb98c073720 2024-09-11T14:38:47.567 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.569+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb97003e8a0 msgr2=0x7fb970040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb97003e8a0 0x7fb970040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 msgr2=0x7fb98c1ca740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c1ca740 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 shutdown_connections 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb97003e8a0 0x7fb970040db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:47.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 --2- 172.21.15.52:0/2515228169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c073720 0x7fb98c1ca740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:47.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 >> 172.21.15.52:0/2515228169 conn(0x7fb98c06f0a0 msgr2=0x7fb98c071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:47.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 shutdown_connections 2024-09-11T14:38:47.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.570+0000 7fb992f51640 1 -- 172.21.15.52:0/2515228169 wait complete. 2024-09-11T14:38:47.587 DEBUG:teuthology.orchestra.run.smithi052:> rbd --cluster ceph pool init rbd 2024-09-11T14:38:47.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.694+0000 7ff75e64aac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:47.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.694+0000 7ff75e64aac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:47.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.696+0000 7ff75e64aac0 1 Processor -- start 2024-09-11T14:38:47.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.696+0000 7ff75e64aac0 1 -- start start 2024-09-11T14:38:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff75e64aac0 1 --2- >> v2:172.21.15.52:3300/0 conn(0x1956430 0x1956840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff75e64aac0 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1722180 con 0x1956d80 2024-09-11T14:38:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff75e64aac0 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x1761b90 con 0x1956430 2024-09-11T14:38:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff758845640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x1956430 0x1956840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:47.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff758845640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x1956430 0x1956840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40250/0 (socket says 172.21.15.52:40250) 2024-09-11T14:38:47.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff758845640 1 -- 172.21.15.52:0/918685964 learned_addr learned my addr 172.21.15.52:0/918685964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:47.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff753fff640 1 --1- 172.21.15.52:0/918685964 >> v1:172.21.15.52:6789/0 conn(0x1956d80 0x18bd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48006/0 (socket says 172.21.15.52:48006) 2024-09-11T14:38:47.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff758845640 1 -- 172.21.15.52:0/918685964 >> v1:172.21.15.52:6789/0 conn(0x1956d80 legacy=0x18bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:47.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff7537fe640 1 -- 172.21.15.52:0/918685964 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676050275 0 0) 0x1722180 con 0x1956d80 2024-09-11T14:38:47.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.699+0000 7ff758845640 1 -- 172.21.15.52:0/918685964 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x16f7f80 con 0x1956430 2024-09-11T14:38:47.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.701+0000 7ff758845640 1 --2- 172.21.15.52:0/918685964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1956840 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc5bc42ea827a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:47.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.701+0000 7ff7537fe640 1 -- 172.21.15.52:0/918685964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff74802d8c0 con 0x1956430 2024-09-11T14:38:47.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.701+0000 7ff7537fe640 1 -- 172.21.15.52:0/918685964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff74802da20 con 0x1956430 2024-09-11T14:38:47.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.701+0000 7ff7537fe640 1 -- 172.21.15.52:0/918685964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff74802dcc0 con 0x1956430 2024-09-11T14:38:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 -- 172.21.15.52:0/918685964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 msgr2=0x1956840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/918685964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1956840 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 -- 172.21.15.52:0/918685964 shutdown_connections 2024-09-11T14:38:47.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/918685964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1956840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 -- 172.21.15.52:0/918685964 >> 172.21.15.52:0/918685964 conn(0x16caf70 msgr2=0x18bbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 -- 172.21.15.52:0/918685964 shutdown_connections 2024-09-11T14:38:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 1 -- 172.21.15.52:0/918685964 wait complete. 2024-09-11T14:38:47.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.702+0000 7ff75e64aac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:47.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.704+0000 7ff75e64aac0 1 Processor -- start 2024-09-11T14:38:47.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.704+0000 7ff75e64aac0 1 -- start start 2024-09-11T14:38:47.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.706+0000 7ff75e64aac0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1955ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:47.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.706+0000 7ff75e64aac0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x176c8f0 con 0x1956430 2024-09-11T14:38:47.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.706+0000 7ff758845640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1955ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:47.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.706+0000 7ff758845640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1955ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40258/0 (socket says 172.21.15.52:40258) 2024-09-11T14:38:47.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.706+0000 7ff758845640 1 -- 172.21.15.52:0/576001239 learned_addr learned my addr 172.21.15.52:0/576001239 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:47.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff758845640 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1706800 con 0x1956430 2024-09-11T14:38:47.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff758845640 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1955ee0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:47.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff74802d8c0 con 0x1956430 2024-09-11T14:38:47.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff7480057c0 con 0x1956430 2024-09-11T14:38:47.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff74802dcc0 con 0x1956430 2024-09-11T14:38:47.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x16f8310 con 0x1956430 2024-09-11T14:38:47.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.707+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x16f7d70 con 0x1956430 2024-09-11T14:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.708+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7ff748006d10 con 0x1956430 2024-09-11T14:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.709+0000 7ff750ff9640 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7ff73803d130 0x7ff73803f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.709+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7ff748032040 con 0x1956430 2024-09-11T14:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.709+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x1947ec0 con 0x1956430 2024-09-11T14:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.709+0000 7ff753fff640 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7ff73803d130 0x7ff73803f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:47.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:47.710+0000 7ff753fff640 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7ff73803d130 0x7ff73803f640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:48.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.569+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7ff748038770 con 0x1956430 2024-09-11T14:38:48.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.570+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x171f520 con 0x1956430 2024-09-11T14:38:48.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.573+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7ff748038770 con 0x1956430 2024-09-11T14:38:48.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.573+0000 7ff752ffd640 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7ff730002ae0 con 0x1956430 2024-09-11T14:38:48.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.574+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(13..13 src has 1..13) ==== 658+0+0 (crc 0 0 0) 0x7ff748034800 con 0x1956430 2024-09-11T14:38:48.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.574+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6802/4284075780 conn(0x1956d80 0x1944980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:48.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.574+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x1969540 con 0x1956d80 2024-09-11T14:38:48.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.580+0000 7ff759aa7640 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6802/4284075780 conn(0x1956d80 0x1944980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:48.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.630+0000 7ff759aa7640 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6802/4284075780 conn(0x1956d80 0x1944980 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:48.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.724+0000 7ff759aa7640 1 -- 172.21.15.52:0/576001239 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7ff74c00a4b0 con 0x1956d80 2024-09-11T14:38:48.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.728+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6807/1907008724 conn(0x19bc190 0x19be670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:48.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.728+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x19bec40 con 0x19bc190 2024-09-11T14:38:48.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.729+0000 7ff758845640 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6807/1907008724 conn(0x19bc190 0x19be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:48.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.732+0000 7ff758845640 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6807/1907008724 conn(0x19bc190 0x19be670 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:48.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.737+0000 7ff758845640 1 -- 172.21.15.52:0/576001239 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff748035040 con 0x19bc190 2024-09-11T14:38:48.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.737+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x19bb650 con 0x19bc190 2024-09-11T14:38:48.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.741+0000 7ff758845640 1 -- 172.21.15.52:0/576001239 <== osd.0 v2:172.21.15.52:6807/1907008724 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff748035040 con 0x19bc190 2024-09-11T14:38:48.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:48.741+0000 7ff7527fc640 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7ff734001f60 con 0x1956430 2024-09-11T14:38:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.657+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff748035620 con 0x1956430 2024-09-11T14:38:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.659+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7ff7480022b0 con 0x1956430 2024-09-11T14:38:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.660+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7ff7380427c0 con 0x1956430 2024-09-11T14:38:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.660+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 11 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7ff7480026d0 con 0x1956430 2024-09-11T14:38:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.660+0000 7ff752ffd640 1 -- 172.21.15.52:0/576001239 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7ff730005640 con 0x19bc190 2024-09-11T14:38:49.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.715+0000 7ff758845640 1 -- 172.21.15.52:0/576001239 <== osd.0 v2:172.21.15.52:6807/1907008724 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff748035040 con 0x19bc190 2024-09-11T14:38:49.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:49.715+0000 7ff7527fc640 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7ff734003370 con 0x1956430 2024-09-11T14:38:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.657+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7ff7480024c0 con 0x1956430 2024-09-11T14:38:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.657+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7ff738042950 con 0x1956430 2024-09-11T14:38:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.657+0000 7ff750ff9640 1 -- 172.21.15.52:0/576001239 <== mon.0 v2:172.21.15.52:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7ff7480024c0 con 0x1956430 2024-09-11T14:38:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.658+0000 7ff752ffd640 1 -- 172.21.15.52:0/576001239 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7ff7300059e0 con 0x19bc190 2024-09-11T14:38:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.715+0000 7ff758845640 1 -- 172.21.15.52:0/576001239 <== osd.0 v2:172.21.15.52:6807/1907008724 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff748035040 con 0x19bc190 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6807/1907008724 conn(0x19bc190 msgr2=0x19be670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6807/1907008724 conn(0x19bc190 0x19be670 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6802/4284075780 conn(0x1956d80 msgr2=0x1944980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6802/4284075780 conn(0x1956d80 0x1944980 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7ff73803d130 msgr2=0x7ff73803f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7ff73803d130 0x7ff73803f640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 msgr2=0x1955ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1955ee0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 shutdown_connections 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6807/1907008724 conn(0x19bc190 0x19be670 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> v2:172.21.15.52:6802/4284075780 conn(0x1956d80 0x1944980 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7ff73803d130 0x7ff73803f640 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 --2- 172.21.15.52:0/576001239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1956430 0x1955ee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 >> 172.21.15.52:0/576001239 conn(0x16caf70 msgr2=0x18c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 shutdown_connections 2024-09-11T14:38:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.716+0000 7ff75e64aac0 1 -- 172.21.15.52:0/576001239 wait complete. 2024-09-11T14:38:50.722 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T14:38:50.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T14:38:50.723 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T14:38:50.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.832+0000 7feadea63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:50.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.839+0000 7feadea63640 1 Processor -- start 2024-09-11T14:38:50.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.839+0000 7feadea63640 1 -- start start 2024-09-11T14:38:50.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7feadea63640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fead8135c50 0x7fead8138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:50.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7feadea63640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead809e790 con 0x7fead812c590 2024-09-11T14:38:50.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7feadea63640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fead812d0b0 con 0x7fead8135c50 2024-09-11T14:38:50.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7fead77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fead8135c50 0x7fead8138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7fead77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fead8135c50 0x7fead8138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40266/0 (socket says 172.21.15.52:40266) 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7fead7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fead812c590 0x7fead812c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48012/0 (socket says 172.21.15.52:48012) 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.840+0000 7fead77fe640 1 -- 172.21.15.52:0/57371526 learned_addr learned my addr 172.21.15.52:0/57371526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.841+0000 7fead77fe640 1 -- 172.21.15.52:0/57371526 >> v1:172.21.15.52:6789/0 conn(0x7fead812c590 legacy=0x7fead812c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.841+0000 7fead77fe640 1 -- 172.21.15.52:0/57371526 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead809ecd0 con 0x7fead8135c50 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.841+0000 7fead77fe640 1 --2- 172.21.15.52:0/57371526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead8135c50 0x7fead8138070 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5259feaadb567980 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.841+0000 7fead6ffd640 1 -- 172.21.15.52:0/57371526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feac0010570 con 0x7fead8135c50 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.841+0000 7fead6ffd640 1 -- 172.21.15.52:0/57371526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feac00106d0 con 0x7fead8135c50 2024-09-11T14:38:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.841+0000 7fead6ffd640 1 -- 172.21.15.52:0/57371526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feac0010970 con 0x7fead8135c50 2024-09-11T14:38:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 -- 172.21.15.52:0/57371526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead8135c50 msgr2=0x7fead8138070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 --2- 172.21.15.52:0/57371526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead8135c50 0x7fead8138070 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 -- 172.21.15.52:0/57371526 shutdown_connections 2024-09-11T14:38:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 --2- 172.21.15.52:0/57371526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead8135c50 0x7fead8138070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 -- 172.21.15.52:0/57371526 >> 172.21.15.52:0/57371526 conn(0x7fead806eb10 msgr2=0x7fead806ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 -- 172.21.15.52:0/57371526 shutdown_connections 2024-09-11T14:38:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 1 -- 172.21.15.52:0/57371526 wait complete. 2024-09-11T14:38:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.842+0000 7feadea63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.844+0000 7feadea63640 1 Processor -- start 2024-09-11T14:38:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.844+0000 7feadea63640 1 -- start start 2024-09-11T14:38:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7feadea63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 0x7fead8071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7feadea63640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fead81202e0 con 0x7fead812c590 2024-09-11T14:38:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 0x7fead8071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 0x7fead8071a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40282/0 (socket says 172.21.15.52:40282) 2024-09-11T14:38:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead7fff640 1 -- 172.21.15.52:0/1738551689 learned_addr learned my addr 172.21.15.52:0/1738551689 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead7fff640 1 -- 172.21.15.52:0/1738551689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead8073d00 con 0x7fead812c590 2024-09-11T14:38:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead7fff640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 0x7fead8071a10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feac80059a0 con 0x7fead812c590 2024-09-11T14:38:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feac8005b00 con 0x7fead812c590 2024-09-11T14:38:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.846+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead8131ce0 con 0x7fead812c590 2024-09-11T14:38:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.847+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feac8005da0 con 0x7fead812c590 2024-09-11T14:38:50.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.847+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead812b9e0 con 0x7fead812c590 2024-09-11T14:38:50.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.848+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead806a460 con 0x7fead812c590 2024-09-11T14:38:50.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.848+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feac80070b0 con 0x7fead812c590 2024-09-11T14:38:50.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.848+0000 7fead4ff9640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feab803e930 0x7feab8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:50.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.848+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7feac804f510 con 0x7fead812c590 2024-09-11T14:38:50.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.848+0000 7fead77fe640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feab803e930 0x7feab8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.849+0000 7fead77fe640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feab803e930 0x7feab8040e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:50.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:50.853+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7feac800f230 con 0x7fead812c590 2024-09-11T14:38:51.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.040+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fead812bc30 con 0x7fead812c590 2024-09-11T14:38:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.041+0000 7fead4ff9640 1 -- 172.21.15.52:0/1738551689 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7fead812bc30 con 0x7fead812c590 2024-09-11T14:38:51.042 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:51.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feab803e930 msgr2=0x7feab8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feab803e930 0x7feab8040e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 msgr2=0x7fead8071a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 0x7fead8071a10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 shutdown_connections 2024-09-11T14:38:51.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feab803e930 0x7feab8040e40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 --2- 172.21.15.52:0/1738551689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fead812c590 0x7fead8071a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 >> 172.21.15.52:0/1738551689 conn(0x7fead806eb10 msgr2=0x7fead81330a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:51.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 shutdown_connections 2024-09-11T14:38:51.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.043+0000 7feadea63640 1 -- 172.21.15.52:0/1738551689 wait complete. 2024-09-11T14:38:51.055 INFO:teuthology.orchestra.run.smithi052.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-11T14:38:51.055 INFO:tasks.ceph_manager:config epoch is 1 2024-09-11T14:38:51.055 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T14:38:51.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T14:38:51.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T14:38:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.163+0000 7f772f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.168+0000 7f772f991640 1 Processor -- start 2024-09-11T14:38:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.168+0000 7f772f991640 1 -- start start 2024-09-11T14:38:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.169+0000 7f772f991640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f77280a4930 0x7f772813b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.169+0000 7f772f991640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772806ec50 con 0x7f77280a3e10 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.169+0000 7f772f991640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f77280a6130 con 0x7f77280a4930 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772cf2c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f77280a4930 0x7f772813b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772cf2c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f77280a4930 0x7f772813b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40290/0 (socket says 172.21.15.52:40290) 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772cf2c640 1 -- 172.21.15.52:0/3645932334 learned_addr learned my addr 172.21.15.52:0/3645932334 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772d72d640 1 --1- 172.21.15.52:0/3645932334 >> v1:172.21.15.52:6789/0 conn(0x7f77280a3e10 0x7f77280a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48028/0 (socket says 172.21.15.52:48028) 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772cf2c640 1 -- 172.21.15.52:0/3645932334 >> v1:172.21.15.52:6789/0 conn(0x7f77280a3e10 legacy=0x7f77280a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772cf2c640 1 -- 172.21.15.52:0/3645932334 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77280a5110 con 0x7f77280a4930 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f772cf2c640 1 --2- 172.21.15.52:0/3645932334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a4930 0x7f772813b2d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd1cce1ce7da417 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f7727fff640 1 -- 172.21.15.52:0/3645932334 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f771c009e50 con 0x7f77280a4930 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f7727fff640 1 -- 172.21.15.52:0/3645932334 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f771c00e230 con 0x7f77280a4930 2024-09-11T14:38:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.170+0000 7f7727fff640 1 -- 172.21.15.52:0/3645932334 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f771c00e4d0 con 0x7f77280a4930 2024-09-11T14:38:51.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 -- 172.21.15.52:0/3645932334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a4930 msgr2=0x7f772813b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 --2- 172.21.15.52:0/3645932334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a4930 0x7f772813b2d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 -- 172.21.15.52:0/3645932334 shutdown_connections 2024-09-11T14:38:51.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 --2- 172.21.15.52:0/3645932334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a4930 0x7f772813b2d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 -- 172.21.15.52:0/3645932334 >> 172.21.15.52:0/3645932334 conn(0x7f77280a74f0 msgr2=0x7f77280a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 -- 172.21.15.52:0/3645932334 shutdown_connections 2024-09-11T14:38:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 1 -- 172.21.15.52:0/3645932334 wait complete. 2024-09-11T14:38:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.171+0000 7f772f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.173+0000 7f772f991640 1 Processor -- start 2024-09-11T14:38:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.174+0000 7f772f991640 1 -- start start 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.175+0000 7f772f991640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 0x7f7728123920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.175+0000 7f772f991640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77281253a0 con 0x7f77280a3e10 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.175+0000 7f772d72d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 0x7f7728123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.175+0000 7f772d72d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 0x7f7728123920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40304/0 (socket says 172.21.15.52:40304) 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.175+0000 7f772d72d640 1 -- 172.21.15.52:0/1335092632 learned_addr learned my addr 172.21.15.52:0/1335092632 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.175+0000 7f772d72d640 1 -- 172.21.15.52:0/1335092632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7728124b60 con 0x7f77280a3e10 2024-09-11T14:38:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.176+0000 7f772d72d640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 0x7f7728123920 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.176+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77180071e0 con 0x7f77280a3e10 2024-09-11T14:38:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.176+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7718007340 con 0x7f77280a3e10 2024-09-11T14:38:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.176+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7728125c50 con 0x7f77280a3e10 2024-09-11T14:38:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.176+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77180075e0 con 0x7f77280a3e10 2024-09-11T14:38:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.176+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77281263d0 con 0x7f77280a3e10 2024-09-11T14:38:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.177+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7718007790 con 0x7f77280a3e10 2024-09-11T14:38:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.177+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77281277f0 con 0x7f77280a3e10 2024-09-11T14:38:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.177+0000 7f7725ffb640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f771403e930 0x7f7714040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.177+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f77180502d0 con 0x7f77280a3e10 2024-09-11T14:38:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.178+0000 7f772cf2c640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f771403e930 0x7f7714040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.178+0000 7f772cf2c640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f771403e930 0x7f7714040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.183+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f7718009bc0 con 0x7f77280a3e10 2024-09-11T14:38:51.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.417+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f772806e050 con 0x7f77280a3e10 2024-09-11T14:38:51.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.419+0000 7f7725ffb640 1 -- 172.21.15.52:0/1335092632 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97903 (crc 0 0 0) 0x7f7718020e60 con 0x7f77280a3e10 2024-09-11T14:38:51.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f771403e930 msgr2=0x7f7714040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f771403e930 0x7f7714040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 msgr2=0x7f7728123920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 0x7f7728123920 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 shutdown_connections 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f771403e930 0x7f7714040e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 --2- 172.21.15.52:0/1335092632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77280a3e10 0x7f7728123920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 >> 172.21.15.52:0/1335092632 conn(0x7f77280a74f0 msgr2=0x7f7728071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 shutdown_connections 2024-09-11T14:38:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.421+0000 7f772f991640 1 -- 172.21.15.52:0/1335092632 wait complete. 2024-09-11T14:38:51.433 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":310319615},{"type":"v1","addr":"172.21.15.143:6801","nonce":310319615}]},"active_addr":"172.21.15.143:6801/310319615","active_change":"2024-09-11T14:38:40.901075+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1788975624}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":2807298720}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":306554685}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":373028349}]}]} 2024-09-11T14:38:51.435 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T14:38:51.436 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T14:38:51.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:38:51.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.544+0000 7f56f2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.549+0000 7f56f2991640 1 Processor -- start 2024-09-11T14:38:51.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.549+0000 7f56f2991640 1 -- start start 2024-09-11T14:38:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.550+0000 7f56f2991640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f56ec0a3e10 0x7f56ec0a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.550+0000 7f56f2991640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56ec06ec50 con 0x7f56ec0a4760 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.550+0000 7f56f2991640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec0a6130 con 0x7f56ec0a3e10 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56ebfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f56ec0a3e10 0x7f56ec0a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56eb7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f56ec0a4760 0x7f56ec135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48038/0 (socket says 172.21.15.52:48038) 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56ebfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f56ec0a3e10 0x7f56ec0a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40306/0 (socket says 172.21.15.52:40306) 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56eb7fe640 1 -- 172.21.15.52:0/239456352 learned_addr learned my addr 172.21.15.52:0/239456352 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56ebfff640 1 -- 172.21.15.52:0/239456352 >> v1:172.21.15.52:6789/0 conn(0x7f56ec0a4760 legacy=0x7f56ec135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56ebfff640 1 -- 172.21.15.52:0/239456352 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec0a5110 con 0x7f56ec0a3e10 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56eaffd640 1 -- 172.21.15.52:0/239456352 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82464754 0 0) 0x7f56ec06ec50 con 0x7f56ec0a4760 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56ebfff640 1 --2- 172.21.15.52:0/239456352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec0a4220 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efec12e527f0463 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56eaffd640 1 -- 172.21.15.52:0/239456352 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f56dc009d90 con 0x7f56ec0a3e10 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56eaffd640 1 -- 172.21.15.52:0/239456352 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f56dc00e230 con 0x7f56ec0a3e10 2024-09-11T14:38:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.551+0000 7f56eaffd640 1 -- 172.21.15.52:0/239456352 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f56dc00e4d0 con 0x7f56ec0a3e10 2024-09-11T14:38:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 -- 172.21.15.52:0/239456352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 msgr2=0x7f56ec0a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 --2- 172.21.15.52:0/239456352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec0a4220 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 -- 172.21.15.52:0/239456352 shutdown_connections 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 --2- 172.21.15.52:0/239456352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec0a4220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 -- 172.21.15.52:0/239456352 >> 172.21.15.52:0/239456352 conn(0x7f56ec0a74f0 msgr2=0x7f56ec0a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 -- 172.21.15.52:0/239456352 shutdown_connections 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 1 -- 172.21.15.52:0/239456352 wait complete. 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.552+0000 7f56f2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.554+0000 7f56f2991640 1 Processor -- start 2024-09-11T14:38:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.554+0000 7f56f2991640 1 -- start start 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56f2991640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec123df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56f2991640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec126070 con 0x7f56ec0a3e10 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56ebfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec123df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56ebfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec123df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40314/0 (socket says 172.21.15.52:40314) 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56ebfff640 1 -- 172.21.15.52:0/3601533317 learned_addr learned my addr 172.21.15.52:0/3601533317 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56ebfff640 1 -- 172.21.15.52:0/3601533317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec1251c0 con 0x7f56ec0a3e10 2024-09-11T14:38:51.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.556+0000 7f56ebfff640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec123df0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.557+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f56dc013610 con 0x7f56ec0a3e10 2024-09-11T14:38:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.557+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f56dc013770 con 0x7f56ec0a3e10 2024-09-11T14:38:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.557+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec123780 con 0x7f56ec0a3e10 2024-09-11T14:38:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.557+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f56dc013a10 con 0x7f56ec0a3e10 2024-09-11T14:38:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.557+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec123a50 con 0x7f56ec0a3e10 2024-09-11T14:38:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.558+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec125ae0 con 0x7f56ec0a3e10 2024-09-11T14:38:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.558+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f56dc013bc0 con 0x7f56ec0a3e10 2024-09-11T14:38:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.558+0000 7f56e8ff9640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f56cc03e960 0x7f56cc040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.558+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f56dc018040 con 0x7f56ec0a3e10 2024-09-11T14:38:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.559+0000 7f56eb7fe640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f56cc03e960 0x7f56cc040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.559+0000 7f56eb7fe640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f56cc03e960 0x7f56cc040e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.563+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f56dc011380 con 0x7f56ec0a3e10 2024-09-11T14:38:51.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.750+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56ec0a56d0 con 0x7f56ec0a3e10 2024-09-11T14:38:51.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.751+0000 7f56e8ff9640 1 -- 172.21.15.52:0/3601533317 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8883 (crc 0 0 0) 0x7f56dc018bf0 con 0x7f56ec0a3e10 2024-09-11T14:38:51.752 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:51.752 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"a6b5d4a4-66d9-4a76-9e4a-eb916006be26","created":"2024-09-11T14:38:36.445816+0000","modified":"2024-09-11T14:38:50.653135+0000","last_up_change":"2024-09-11T14:38:43.548076+0000","last_in_change":"2024-09-11T14:38:38.572455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:38:44.937773+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:38:46.777496+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2ba10be-8405-43e0-bf6c-00ee6c90d481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6807","nonce":1907008724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1907008724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1907008724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1907008724}]},"public_addr":"172.21.15.52:6807/1907008724","cluster_addr":"172.21.15.52:6806/1907008724","heartbeat_back_addr":"172.21.15.52:6808/1907008724","heartbeat_front_addr":"172.21.15.52:6800/1907008724","state":["exists","up"]},{"osd":1,"uuid":"88407485-bd36-46fd-9dcb-611a3f99f4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4284075780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6801","nonce":4284075780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6805","nonce":4284075780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":4284075780}]},"public_addr":"172.21.15.52:6802/4284075780","cluster_addr":"172.21.15.52:6801/4284075780","heartbeat_back_addr":"172.21.15.52:6805/4284075780","heartbeat_front_addr":"172.21.15.52:6804/4284075780","state":["exists","up"]},{"osd":2,"uuid":"46f85cbf-34b9-4cf9-9cb7-6390b1b37448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2099775818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6809","nonce":2099775818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2099775818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":2099775818}]},"public_addr":"172.21.15.143:6808/2099775818","cluster_addr":"172.21.15.143:6809/2099775818","heartbeat_back_addr":"172.21.15.143:6820/2099775818","heartbeat_front_addr":"172.21.15.143:6819/2099775818","state":["exists","up"]},{"osd":3,"uuid":"578c9a69-f18b-4318-9428-c582ab58eb18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6803","nonce":3147275988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3147275988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3147275988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":3147275988}]},"public_addr":"172.21.15.143:6803/3147275988","cluster_addr":"172.21.15.143:6802/3147275988","heartbeat_back_addr":"172.21.15.143:6810/3147275988","heartbeat_front_addr":"172.21.15.143:6807/3147275988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f56cc03e960 msgr2=0x7f56cc040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f56cc03e960 0x7f56cc040e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 msgr2=0x7f56ec123df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec123df0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 shutdown_connections 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f56cc03e960 0x7f56cc040e70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 --2- 172.21.15.52:0/3601533317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56ec0a3e10 0x7f56ec123df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.753+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 >> 172.21.15.52:0/3601533317 conn(0x7f56ec0a74f0 msgr2=0x7f56ec0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.754+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 shutdown_connections 2024-09-11T14:38:51.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.754+0000 7f56f2991640 1 -- 172.21.15.52:0/3601533317 wait complete. 2024-09-11T14:38:51.765 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T14:38:51.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:38:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.874+0000 7fc3ab2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.879+0000 7fc3ab2d1640 1 Processor -- start 2024-09-11T14:38:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.879+0000 7fc3ab2d1640 1 -- start start 2024-09-11T14:38:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.880+0000 7fc3ab2d1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc3a409d0f0 0x7fc3a4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.880+0000 7fc3ab2d1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a4074a70 con 0x7fc3a409e6c0 2024-09-11T14:38:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.880+0000 7fc3ab2d1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a40a61f0 con 0x7fc3a409d0f0 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a886c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc3a409d0f0 0x7fc3a4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a906d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc3a409e6c0 0x7fc3a409c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48044/0 (socket says 172.21.15.52:48044) 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a886c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc3a409d0f0 0x7fc3a4138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40322/0 (socket says 172.21.15.52:40322) 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a906d640 1 -- 172.21.15.52:0/3231049795 learned_addr learned my addr 172.21.15.52:0/3231049795 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a886c640 1 -- 172.21.15.52:0/3231049795 >> v1:172.21.15.52:6789/0 conn(0x7fc3a409e6c0 legacy=0x7fc3a409c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a886c640 1 -- 172.21.15.52:0/3231049795 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a40a5ee0 con 0x7fc3a409d0f0 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc3a886c640 1 --2- 172.21.15.52:0/3231049795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4138ee0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce2863064264cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc397fff640 1 -- 172.21.15.52:0/3231049795 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc398009d80 con 0x7fc3a409d0f0 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc397fff640 1 -- 172.21.15.52:0/3231049795 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc39800e230 con 0x7fc3a409d0f0 2024-09-11T14:38:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.881+0000 7fc397fff640 1 -- 172.21.15.52:0/3231049795 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc39800e4d0 con 0x7fc3a409d0f0 2024-09-11T14:38:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/3231049795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 msgr2=0x7fc3a4138ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 --2- 172.21.15.52:0/3231049795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4138ee0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/3231049795 shutdown_connections 2024-09-11T14:38:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 --2- 172.21.15.52:0/3231049795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4138ee0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/3231049795 >> 172.21.15.52:0/3231049795 conn(0x7fc3a40a43e0 msgr2=0x7fc3a4073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/3231049795 shutdown_connections 2024-09-11T14:38:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/3231049795 wait complete. 2024-09-11T14:38:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.882+0000 7fc3ab2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.884+0000 7fc3ab2d1640 1 Processor -- start 2024-09-11T14:38:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.884+0000 7fc3ab2d1640 1 -- start start 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3ab2d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4123c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3ab2d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4124630 con 0x7fc3a409d0f0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3a906d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4123c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3a906d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4123c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40328/0 (socket says 172.21.15.52:40328) 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3a906d640 1 -- 172.21.15.52:0/241280724 learned_addr learned my addr 172.21.15.52:0/241280724 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3a906d640 1 -- 172.21.15.52:0/241280724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a4122550 con 0x7fc3a409d0f0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc3a906d640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4123c00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.886+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3a0005a60 con 0x7fc3a409d0f0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.887+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3a0005bc0 con 0x7fc3a409d0f0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.887+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a4124340 con 0x7fc3a409d0f0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.887+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3a0005e60 con 0x7fc3a409d0f0 2024-09-11T14:38:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.887+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a41249b0 con 0x7fc3a409d0f0 2024-09-11T14:38:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.888+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc3a000c820 con 0x7fc3a409d0f0 2024-09-11T14:38:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.888+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a409c9e0 con 0x7fc3a409d0f0 2024-09-11T14:38:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.888+0000 7fc395ffb640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc38803e8e0 0x7fc388040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.888+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fc3a004f680 con 0x7fc3a409d0f0 2024-09-11T14:38:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.888+0000 7fc3a886c640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc38803e8e0 0x7fc388040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.889+0000 7fc3a886c640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc38803e8e0 0x7fc388040df0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:51.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:51.893+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc3a000dc60 con 0x7fc3a409d0f0 2024-09-11T14:38:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.082+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3a41232e0 con 0x7fc3a409d0f0 2024-09-11T14:38:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.082+0000 7fc395ffb640 1 -- 172.21.15.52:0/241280724 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8883 (crc 0 0 0) 0x7fc3a000d660 con 0x7fc3a409d0f0 2024-09-11T14:38:52.084 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:52.084 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"a6b5d4a4-66d9-4a76-9e4a-eb916006be26","created":"2024-09-11T14:38:36.445816+0000","modified":"2024-09-11T14:38:50.653135+0000","last_up_change":"2024-09-11T14:38:43.548076+0000","last_in_change":"2024-09-11T14:38:38.572455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:38:44.937773+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:38:46.777496+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2ba10be-8405-43e0-bf6c-00ee6c90d481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6807","nonce":1907008724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1907008724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1907008724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1907008724}]},"public_addr":"172.21.15.52:6807/1907008724","cluster_addr":"172.21.15.52:6806/1907008724","heartbeat_back_addr":"172.21.15.52:6808/1907008724","heartbeat_front_addr":"172.21.15.52:6800/1907008724","state":["exists","up"]},{"osd":1,"uuid":"88407485-bd36-46fd-9dcb-611a3f99f4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4284075780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6801","nonce":4284075780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6805","nonce":4284075780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":4284075780}]},"public_addr":"172.21.15.52:6802/4284075780","cluster_addr":"172.21.15.52:6801/4284075780","heartbeat_back_addr":"172.21.15.52:6805/4284075780","heartbeat_front_addr":"172.21.15.52:6804/4284075780","state":["exists","up"]},{"osd":2,"uuid":"46f85cbf-34b9-4cf9-9cb7-6390b1b37448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2099775818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6809","nonce":2099775818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2099775818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":2099775818}]},"public_addr":"172.21.15.143:6808/2099775818","cluster_addr":"172.21.15.143:6809/2099775818","heartbeat_back_addr":"172.21.15.143:6820/2099775818","heartbeat_front_addr":"172.21.15.143:6819/2099775818","state":["exists","up"]},{"osd":3,"uuid":"578c9a69-f18b-4318-9428-c582ab58eb18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6803","nonce":3147275988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3147275988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3147275988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":3147275988}]},"public_addr":"172.21.15.143:6803/3147275988","cluster_addr":"172.21.15.143:6802/3147275988","heartbeat_back_addr":"172.21.15.143:6810/3147275988","heartbeat_front_addr":"172.21.15.143:6807/3147275988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:38:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc38803e8e0 msgr2=0x7fc388040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc38803e8e0 0x7fc388040df0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 msgr2=0x7fc3a4123c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4123c00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 shutdown_connections 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc38803e8e0 0x7fc388040df0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 --2- 172.21.15.52:0/241280724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3a409d0f0 0x7fc3a4123c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 >> 172.21.15.52:0/241280724 conn(0x7fc3a40a43e0 msgr2=0x7fc3a41bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 shutdown_connections 2024-09-11T14:38:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.085+0000 7fc3ab2d1640 1 -- 172.21.15.52:0/241280724 wait complete. 2024-09-11T14:38:52.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T14:38:52.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T14:38:52.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T14:38:52.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T14:38:52.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.217+0000 7f4afdc57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.217+0000 7f32dbaa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.217+0000 7f0322791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.217+0000 7fd036874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.223+0000 7f32dbaa3640 1 Processor -- start 2024-09-11T14:38:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.223+0000 7f0322791640 1 Processor -- start 2024-09-11T14:38:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.223+0000 7fd036874640 1 Processor -- start 2024-09-11T14:38:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.224+0000 7f32dbaa3640 1 -- start start 2024-09-11T14:38:52.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.224+0000 7f4afdc57640 1 Processor -- start 2024-09-11T14:38:52.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.224+0000 7f0322791640 1 -- start start 2024-09-11T14:38:52.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.224+0000 7f4afdc57640 1 -- start start 2024-09-11T14:38:52.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.224+0000 7fd036874640 1 -- start start 2024-09-11T14:38:52.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f0322791640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f031c09d0f0 0x7f031c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f0322791640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f031c074a70 con 0x7f031c09e6c0 2024-09-11T14:38:52.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f0322791640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f031c0a61f0 con 0x7f031c09d0f0 2024-09-11T14:38:52.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f32dbaa3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32d40a3e10 0x7f32d40a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f4afdc57640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4af80a4930 0x7f4af813b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f031b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f031c09d0f0 0x7f031c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f4afdc57640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af806ec50 con 0x7f4af80a3e10 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f4afdc57640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80a6130 con 0x7f4af80a4930 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f4af77fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4af80a3e10 0x7f4af80a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48064/0 (socket says 172.21.15.52:48064) 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f4af77fe640 1 -- 172.21.15.52:0/2794759395 learned_addr learned my addr 172.21.15.52:0/2794759395 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7fd036874640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd030073d10 0x7fd030138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7fd036874640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03009d940 con 0x7fd0300731f0 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7fd036874640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd03009d1c0 con 0x7fd030073d10 2024-09-11T14:38:52.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f031bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f031c09e6c0 0x7f031c09c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48048/0 (socket says 172.21.15.52:48048) 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f031bfff640 1 -- 172.21.15.52:0/4129550389 learned_addr learned my addr 172.21.15.52:0/4129550389 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f32dbaa3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d406ec50 con 0x7f32d40a4760 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f32dbaa3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f32d40a6130 con 0x7f32d40a3e10 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.225+0000 7f32d903e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f32d40a4760 0x7f32d4135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48062/0 (socket says 172.21.15.52:48062) 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f32d903e640 1 -- 172.21.15.52:0/3882883205 learned_addr learned my addr 172.21.15.52:0/3882883205 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f32d983f640 1 --2- 172.21.15.52:0/3882883205 >> v2:172.21.15.52:3300/0 conn(0x7f32d40a3e10 0x7f32d40a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f4af6ffd640 1 --2- 172.21.15.52:0/2794759395 >> v2:172.21.15.52:3300/0 conn(0x7f4af80a4930 0x7f4af813b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7fd02ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd0300731f0 0x7fd030073600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48068/0 (socket says 172.21.15.52:48068) 2024-09-11T14:38:52.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7fd02ffff640 1 -- 172.21.15.52:0/4210342348 learned_addr learned my addr 172.21.15.52:0/4210342348 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f32d883d640 1 -- 172.21.15.52:0/3882883205 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375833717 0 0) 0x7f32d406ec50 con 0x7f32d40a4760 2024-09-11T14:38:52.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7fd02f7fe640 1 --2- 172.21.15.52:0/4210342348 >> v2:172.21.15.52:3300/0 conn(0x7fd030073d10 0x7fd030138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f4af67fc640 1 -- 172.21.15.52:0/2794759395 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723757279 0 0) 0x7f4af806ec50 con 0x7f4af80a3e10 2024-09-11T14:38:52.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f32d883d640 1 -- 172.21.15.52:0/3882883205 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32c0003580 con 0x7f32d40a4760 2024-09-11T14:38:52.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f4af67fc640 1 -- 172.21.15.52:0/2794759395 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae0003580 con 0x7f4af80a3e10 2024-09-11T14:38:52.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f031b7fe640 1 -- 172.21.15.52:0/4129550389 >> v1:172.21.15.52:6789/0 conn(0x7f031c09e6c0 legacy=0x7f031c09c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f031b7fe640 1 -- 172.21.15.52:0/4129550389 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c0a5ee0 con 0x7f031c09d0f0 2024-09-11T14:38:52.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f32d983f640 1 -- 172.21.15.52:0/3882883205 >> v1:172.21.15.52:6789/0 conn(0x7f32d40a4760 legacy=0x7f32d4135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7f32d983f640 1 -- 172.21.15.52:0/3882883205 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d40a5110 con 0x7f32d40a3e10 2024-09-11T14:38:52.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7fd02f7fe640 1 -- 172.21.15.52:0/4210342348 >> v1:172.21.15.52:6789/0 conn(0x7fd0300731f0 legacy=0x7fd030073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f4af6ffd640 1 -- 172.21.15.52:0/2794759395 >> v1:172.21.15.52:6789/0 conn(0x7f4af80a3e10 legacy=0x7f4af80a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f4af6ffd640 1 -- 172.21.15.52:0/2794759395 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80a5110 con 0x7f4af80a4930 2024-09-11T14:38:52.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.226+0000 7fd02f7fe640 1 -- 172.21.15.52:0/4210342348 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03009e220 con 0x7fd030073d10 2024-09-11T14:38:52.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f031b7fe640 1 --2- 172.21.15.52:0/4129550389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c138ee0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09a0723de303ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f32d983f640 1 --2- 172.21.15.52:0/3882883205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d40a4220 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c528de9ceb020a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7fd02f7fe640 1 --2- 172.21.15.52:0/4210342348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd030073d10 0x7fd030138fc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daab689aec16fe98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f031affd640 1 -- 172.21.15.52:0/4129550389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0310009d80 con 0x7f031c09d0f0 2024-09-11T14:38:52.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f32d883d640 1 -- 172.21.15.52:0/3882883205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f32d0009d90 con 0x7f32d40a3e10 2024-09-11T14:38:52.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f4af6ffd640 1 --2- 172.21.15.52:0/2794759395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a4930 0x7f4af813b2d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33ca9303a1f2c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f32d883d640 1 -- 172.21.15.52:0/3882883205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f32d000e230 con 0x7f32d40a3e10 2024-09-11T14:38:52.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7fd02effd640 1 -- 172.21.15.52:0/4210342348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd024009d90 con 0x7fd030073d10 2024-09-11T14:38:52.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f031affd640 1 -- 172.21.15.52:0/4129550389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f031000e230 con 0x7f031c09d0f0 2024-09-11T14:38:52.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f32d883d640 1 -- 172.21.15.52:0/3882883205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f32d000e4d0 con 0x7f32d40a3e10 2024-09-11T14:38:52.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f031affd640 1 -- 172.21.15.52:0/4129550389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f031000e4d0 con 0x7f031c09d0f0 2024-09-11T14:38:52.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7fd02effd640 1 -- 172.21.15.52:0/4210342348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd02400e230 con 0x7fd030073d10 2024-09-11T14:38:52.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f4af67fc640 1 -- 172.21.15.52:0/2794759395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4aec009d90 con 0x7f4af80a4930 2024-09-11T14:38:52.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f4af67fc640 1 -- 172.21.15.52:0/2794759395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4aec00e230 con 0x7f4af80a4930 2024-09-11T14:38:52.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7fd02effd640 1 -- 172.21.15.52:0/4210342348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd02400e4d0 con 0x7fd030073d10 2024-09-11T14:38:52.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.227+0000 7f4af67fc640 1 -- 172.21.15.52:0/2794759395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4aec00e4d0 con 0x7f4af80a4930 2024-09-11T14:38:52.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 -- 172.21.15.52:0/4129550389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 msgr2=0x7f031c138ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f32dbaa3640 1 -- 172.21.15.52:0/3882883205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 msgr2=0x7f32d40a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 --2- 172.21.15.52:0/4129550389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c138ee0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 -- 172.21.15.52:0/4210342348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd030073d10 msgr2=0x7fd030138fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 --2- 172.21.15.52:0/4210342348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd030073d10 0x7fd030138fc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/3882883205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d40a4220 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 -- 172.21.15.52:0/4210342348 shutdown_connections 2024-09-11T14:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 --2- 172.21.15.52:0/4210342348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd030073d10 0x7fd030138fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 -- 172.21.15.52:0/4210342348 >> 172.21.15.52:0/4210342348 conn(0x7fd0300a6d10 msgr2=0x7fd030071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 -- 172.21.15.52:0/4129550389 shutdown_connections 2024-09-11T14:38:52.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 --2- 172.21.15.52:0/4129550389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c138ee0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 -- 172.21.15.52:0/4129550389 >> 172.21.15.52:0/4129550389 conn(0x7f031c0a43e0 msgr2=0x7f031c073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f4afdc57640 1 -- 172.21.15.52:0/2794759395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a4930 msgr2=0x7f4af813b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 -- 172.21.15.52:0/4210342348 shutdown_connections 2024-09-11T14:38:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f4afdc57640 1 --2- 172.21.15.52:0/2794759395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a4930 0x7f4af813b2d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 -- 172.21.15.52:0/4129550389 shutdown_connections 2024-09-11T14:38:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f0322791640 1 -- 172.21.15.52:0/4129550389 wait complete. 2024-09-11T14:38:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f32dbaa3640 1 -- 172.21.15.52:0/3882883205 shutdown_connections 2024-09-11T14:38:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/3882883205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d40a4220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f32dbaa3640 1 -- 172.21.15.52:0/3882883205 >> 172.21.15.52:0/3882883205 conn(0x7f32d40a74f0 msgr2=0x7f32d40a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f32dbaa3640 1 -- 172.21.15.52:0/3882883205 shutdown_connections 2024-09-11T14:38:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7fd036874640 1 -- 172.21.15.52:0/4210342348 wait complete. 2024-09-11T14:38:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f4afdc57640 1 -- 172.21.15.52:0/2794759395 shutdown_connections 2024-09-11T14:38:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f4afdc57640 1 --2- 172.21.15.52:0/2794759395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a4930 0x7f4af813b2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.228+0000 7f4afdc57640 1 -- 172.21.15.52:0/2794759395 >> 172.21.15.52:0/2794759395 conn(0x7f4af80a74f0 msgr2=0x7f4af80a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.229+0000 7f4afdc57640 1 -- 172.21.15.52:0/2794759395 shutdown_connections 2024-09-11T14:38:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.229+0000 7f32dbaa3640 1 -- 172.21.15.52:0/3882883205 wait complete. 2024-09-11T14:38:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.229+0000 7f0322791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.229+0000 7fd036874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.229+0000 7f32dbaa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.229+0000 7f4afdc57640 1 -- 172.21.15.52:0/2794759395 wait complete. 2024-09-11T14:38:52.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.230+0000 7f4afdc57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.231+0000 7f0322791640 1 Processor -- start 2024-09-11T14:38:52.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.231+0000 7f32dbaa3640 1 Processor -- start 2024-09-11T14:38:52.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.231+0000 7f32dbaa3640 1 -- start start 2024-09-11T14:38:52.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.231+0000 7f0322791640 1 -- start start 2024-09-11T14:38:52.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.231+0000 7fd036874640 1 Processor -- start 2024-09-11T14:38:52.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7fd036874640 1 -- start start 2024-09-11T14:38:52.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f0322791640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c123c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f32dbaa3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d4123df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f32dbaa3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4126070 con 0x7f32d40a3e10 2024-09-11T14:38:52.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f0322791640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f031c124630 con 0x7f031c09d0f0 2024-09-11T14:38:52.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f031bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c123c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f031bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c123c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40364/0 (socket says 172.21.15.52:40364) 2024-09-11T14:38:52.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f32d983f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d4123df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f031bfff640 1 -- 172.21.15.52:0/4009115680 learned_addr learned my addr 172.21.15.52:0/4009115680 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.232+0000 7f32d983f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d4123df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40374/0 (socket says 172.21.15.52:40374) 2024-09-11T14:38:52.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f32d983f640 1 -- 172.21.15.52:0/1994481204 learned_addr learned my addr 172.21.15.52:0/1994481204 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f4afdc57640 1 Processor -- start 2024-09-11T14:38:52.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f031bfff640 1 -- 172.21.15.52:0/4009115680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c122550 con 0x7f031c09d0f0 2024-09-11T14:38:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f32d983f640 1 -- 172.21.15.52:0/1994481204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d41251c0 con 0x7f32d40a3e10 2024-09-11T14:38:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f031bfff640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c123c00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f4afdc57640 1 -- start start 2024-09-11T14:38:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f32d983f640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d4123df0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f030c005a60 con 0x7f031c09d0f0 2024-09-11T14:38:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f030c005bc0 con 0x7f031c09d0f0 2024-09-11T14:38:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f030c005e60 con 0x7f031c09d0f0 2024-09-11T14:38:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.233+0000 7f0322791640 1 -- 172.21.15.52:0/4009115680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c124340 con 0x7f031c09d0f0 2024-09-11T14:38:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7f0322791640 1 -- 172.21.15.52:0/4009115680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c1249b0 con 0x7f031c09d0f0 2024-09-11T14:38:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f32d0014410 con 0x7f32d40a3e10 2024-09-11T14:38:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f32d0014570 con 0x7f32d40a3e10 2024-09-11T14:38:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f32d0014410 con 0x7f32d40a3e10 2024-09-11T14:38:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d4123780 con 0x7f32d40a3e10 2024-09-11T14:38:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d4123a50 con 0x7f32d40a3e10 2024-09-11T14:38:52.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7fd036874640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 0x7fd030121020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.234+0000 7fd036874640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd030123d90 con 0x7fd0300731f0 2024-09-11T14:38:52.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 0x7fd030121020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 0x7fd030121020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40386/0 (socket says 172.21.15.52:40386) 2024-09-11T14:38:52.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7fd02ffff640 1 -- 172.21.15.52:0/2314671442 learned_addr learned my addr 172.21.15.52:0/2314671442 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f031c09d500 con 0x7f031c09d0f0 2024-09-11T14:38:52.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f030c0070b0 con 0x7f031c09d0f0 2024-09-11T14:38:52.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32d4127850 con 0x7f32d40a3e10 2024-09-11T14:38:52.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7fd02ffff640 1 -- 172.21.15.52:0/2314671442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd030122500 con 0x7fd0300731f0 2024-09-11T14:38:52.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7f0318ff9640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f030803e930 0x7f0308040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f030c04f6b0 con 0x7f031c09d0f0 2024-09-11T14:38:52.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.235+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f32d0014780 con 0x7f32d40a3e10 2024-09-11T14:38:52.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7fd02ffff640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 0x7fd030121020 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f0318ff9640 1 --2- 172.21.15.52:0/4009115680 >> v2:172.21.15.143:6803/3147275988 conn(0x7f0308043930 0x7f0308045e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 --> v2:172.21.15.143:6803/3147275988 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0308046490 con 0x7f0308043930 2024-09-11T14:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f030c051ae0 con 0x7f031c09d0f0 2024-09-11T14:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f4afdc57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 0x7f4af8124010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f4afdc57640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8125e70 con 0x7f4af80a3e10 2024-09-11T14:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd020005a60 con 0x7fd0300731f0 2024-09-11T14:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 0x7f4af8124010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd020005bc0 con 0x7fd0300731f0 2024-09-11T14:38:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd030122740 con 0x7fd0300731f0 2024-09-11T14:38:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 0x7f4af8124010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40394/0 (socket says 172.21.15.52:40394) 2024-09-11T14:38:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f4af77fe640 1 -- 172.21.15.52:0/1155553714 learned_addr learned my addr 172.21.15.52:0/1155553714 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd020005e60 con 0x7fd0300731f0 2024-09-11T14:38:52.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f031b7fe640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f030803e930 0x7f0308040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f4af77fe640 1 -- 172.21.15.52:0/1155553714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af8127660 con 0x7f4af80a3e10 2024-09-11T14:38:52.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f4af77fe640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 0x7f4af8124010 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f32ca7fc640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f32b803e990 0x7f32b8040ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f32d0019040 con 0x7f32d40a3e10 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f32d903e640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f32b803e990 0x7f32b8040ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f32ca7fc640 1 --2- 172.21.15.52:0/1994481204 >> v2:172.21.15.52:6802/4284075780 conn(0x7f32b8043990 0x7f32b8045e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 --> v2:172.21.15.52:6802/4284075780 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32b80464f0 con 0x7f32b8043990 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f32d0014410 con 0x7f32d40a3e10 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f32d903e640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f32b803e990 0x7f32b8040ea0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f0320d2e640 1 --2- 172.21.15.52:0/4009115680 >> v2:172.21.15.143:6803/3147275988 conn(0x7f0308043930 0x7f0308045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f031b7fe640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f030803e930 0x7f0308040e40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ae8005a60 con 0x7f4af80a3e10 2024-09-11T14:38:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.236+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0301340c0 con 0x7fd0300731f0 2024-09-11T14:38:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ae8005bc0 con 0x7f4af80a3e10 2024-09-11T14:38:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af8123df0 con 0x7f4af80a3e10 2024-09-11T14:38:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd010000f80 con 0x7fd0300731f0 2024-09-11T14:38:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.237+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd02000c7f0 con 0x7fd0300731f0 2024-09-11T14:38:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7f32da040640 1 --2- 172.21.15.52:0/1994481204 >> v2:172.21.15.52:6802/4284075780 conn(0x7f32b8043990 0x7f32b8045e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7fd02cff9640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd01c03e980 0x7fd01c040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd02004f600 con 0x7fd0300731f0 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7fd02cff9640 1 --2- 172.21.15.52:0/2314671442 >> v2:172.21.15.143:6808/2099775818 conn(0x7fd01c043980 0x7fd01c045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 --> v2:172.21.15.143:6808/2099775818 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd01c0464e0 con 0x7fd01c043980 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7fd020051a70 con 0x7fd0300731f0 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ae8005e60 con 0x7f4af80a3e10 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.238+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af8123a50 con 0x7f4af80a3e10 2024-09-11T14:38:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.239+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4ae80070b0 con 0x7f4af80a3e10 2024-09-11T14:38:52.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.239+0000 7fd02f7fe640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd01c03e980 0x7fd01c040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.239+0000 7f4adffff640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4ae403e930 0x7f4ae4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.239+0000 7fd02f7fe640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd01c03e980 0x7fd01c040e90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.239+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4af80a5e20 con 0x7f4af80a3e10 2024-09-11T14:38:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f4ae804f740 con 0x7f4af80a3e10 2024-09-11T14:38:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7f4adffff640 1 --2- 172.21.15.52:0/1155553714 >> v2:172.21.15.52:6807/1907008724 conn(0x7f4ae4043930 0x7f4ae4045e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7f4af6ffd640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4ae403e930 0x7f4ae4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 --> v2:172.21.15.52:6807/1907008724 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ae4046490 con 0x7f4ae4043930 2024-09-11T14:38:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f4ae800dc60 con 0x7f4af80a3e10 2024-09-11T14:38:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7fd034e11640 1 --2- 172.21.15.52:0/2314671442 >> v2:172.21.15.143:6808/2099775818 conn(0x7fd01c043980 0x7fd01c045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.240+0000 7f0320d2e640 1 --2- 172.21.15.52:0/4009115680 >> v2:172.21.15.143:6803/3147275988 conn(0x7f0308043930 0x7f0308045e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.241+0000 7f4af6ffd640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4ae403e930 0x7f4ae4040e40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.241+0000 7f4af7fff640 1 --2- 172.21.15.52:0/1155553714 >> v2:172.21.15.52:6807/1907008724 conn(0x7f4ae4043930 0x7f4ae4045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.242+0000 7f32da040640 1 --2- 172.21.15.52:0/1994481204 >> v2:172.21.15.52:6802/4284075780 conn(0x7f32b8043990 0x7f32b8045e60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.242+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f0308046490 con 0x7f0308043930 2024-09-11T14:38:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.244+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f32b80464f0 con 0x7f32b8043990 2024-09-11T14:38:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.244+0000 7fd034e11640 1 --2- 172.21.15.52:0/2314671442 >> v2:172.21.15.143:6808/2099775818 conn(0x7fd01c043980 0x7fd01c045e50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.245+0000 7f4af7fff640 1 --2- 172.21.15.52:0/1155553714 >> v2:172.21.15.52:6807/1907008724 conn(0x7f4ae4043930 0x7f4ae4045e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.246+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== osd.2 v2:172.21.15.143:6808/2099775818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fd01c0464e0 con 0x7fd01c043980 2024-09-11T14:38:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.248+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 --> v2:172.21.15.143:6803/3147275988 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f031c09c9e0 con 0x7f0308043930 2024-09-11T14:38:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.248+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f4ae4046490 con 0x7f4ae4043930 2024-09-11T14:38:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 --> v2:172.21.15.52:6802/4284075780 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32d40a5e20 con 0x7f32b8043990 2024-09-11T14:38:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f0318ff9640 1 -- 172.21.15.52:0/4009115680 <== osd.3 v2:172.21.15.143:6803/3147275988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f031c09c9e0 con 0x7f0308043930 2024-09-11T14:38:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 --> v2:172.21.15.143:6808/2099775818 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd010002c30 con 0x7fd01c043980 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 >> v2:172.21.15.143:6803/3147275988 conn(0x7f0308043930 msgr2=0x7f0308045e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 --2- 172.21.15.52:0/4009115680 >> v2:172.21.15.143:6803/3147275988 conn(0x7f0308043930 0x7f0308045e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f030803e930 msgr2=0x7f0308040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f030803e930 0x7f0308040e40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 msgr2=0x7f031c123c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c123c00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 shutdown_connections 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 --2- 172.21.15.52:0/4009115680 >> v2:172.21.15.143:6803/3147275988 conn(0x7f0308043930 0x7f0308045e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.250+0000 7f03027fc640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f030803e930 0x7f0308040e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.251+0000 7f03027fc640 1 --2- 172.21.15.52:0/4009115680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031c09d0f0 0x7f031c123c00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.251+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 >> 172.21.15.52:0/4009115680 conn(0x7f031c0a43e0 msgr2=0x7f031c1bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.251+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 shutdown_connections 2024-09-11T14:38:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.251+0000 7f03027fc640 1 -- 172.21.15.52:0/4009115680 wait complete. 2024-09-11T14:38:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.252+0000 7f32ca7fc640 1 -- 172.21.15.52:0/1994481204 <== osd.1 v2:172.21.15.52:6802/4284075780 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32cc00a820 con 0x7f32b8043990 2024-09-11T14:38:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.252+0000 7fd02cff9640 1 -- 172.21.15.52:0/2314671442 <== osd.2 v2:172.21.15.143:6808/2099775818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd010002c30 con 0x7fd01c043980 2024-09-11T14:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.252+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 >> v2:172.21.15.52:6802/4284075780 conn(0x7f32b8043990 msgr2=0x7f32b8045e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.252+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/1994481204 >> v2:172.21.15.52:6802/4284075780 conn(0x7f32b8043990 0x7f32b8045e60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.252+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 >> v2:172.21.15.143:6808/2099775818 conn(0x7fd01c043980 msgr2=0x7fd01c045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.252+0000 7fd036874640 1 --2- 172.21.15.52:0/2314671442 >> v2:172.21.15.143:6808/2099775818 conn(0x7fd01c043980 0x7fd01c045e50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f32b803e990 msgr2=0x7f32b8040ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f32b803e990 0x7f32b8040ea0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 msgr2=0x7f32d4123df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd01c03e980 msgr2=0x7fd01c040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd01c03e980 0x7fd01c040e90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 msgr2=0x7fd030121020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 0x7fd030121020 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d4123df0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 shutdown_connections 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/1994481204 >> v2:172.21.15.52:6802/4284075780 conn(0x7f32b8043990 0x7f32b8045e60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f32b803e990 0x7f32b8040ea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 --2- 172.21.15.52:0/1994481204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32d40a3e10 0x7f32d4123df0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 >> 172.21.15.52:0/1994481204 conn(0x7f32d40a74f0 msgr2=0x7f32d40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 shutdown_connections 2024-09-11T14:38:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 --2- 172.21.15.52:0/2314671442 >> v2:172.21.15.143:6808/2099775818 conn(0x7fd01c043980 0x7fd01c045e50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd01c03e980 0x7fd01c040e90 crc :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 --2- 172.21.15.52:0/2314671442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0300731f0 0x7fd030121020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 >> 172.21.15.52:0/2314671442 conn(0x7fd0300a6d10 msgr2=0x7fd0300a43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 shutdown_connections 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7fd036874640 1 -- 172.21.15.52:0/2314671442 wait complete. 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 shutdown_connections 2024-09-11T14:38:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f32dbaa3640 1 -- 172.21.15.52:0/1994481204 wait complete. 2024-09-11T14:38:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.253+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 --> v2:172.21.15.52:6807/1907008724 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4af80a5e20 con 0x7f4ae4043930 2024-09-11T14:38:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.265+0000 7f4adffff640 1 -- 172.21.15.52:0/1155553714 <== osd.0 v2:172.21.15.52:6807/1907008724 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4af000a820 con 0x7f4ae4043930 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 >> v2:172.21.15.52:6807/1907008724 conn(0x7f4ae4043930 msgr2=0x7f4ae4045e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 --2- 172.21.15.52:0/1155553714 >> v2:172.21.15.52:6807/1907008724 conn(0x7f4ae4043930 0x7f4ae4045e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4ae403e930 msgr2=0x7f4ae4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4ae403e930 0x7f4ae4040e40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 msgr2=0x7f4af8124010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 0x7f4af8124010 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 shutdown_connections 2024-09-11T14:38:52.278 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:52.278 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:38:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 --2- 172.21.15.52:0/1155553714 >> v2:172.21.15.52:6807/1907008724 conn(0x7f4ae4043930 0x7f4ae4045e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4ae403e930 0x7f4ae4040e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 --2- 172.21.15.52:0/1155553714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80a3e10 0x7f4af8124010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 >> 172.21.15.52:0/1155553714 conn(0x7f4af80a74f0 msgr2=0x7f4af80713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 shutdown_connections 2024-09-11T14:38:52.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.266+0000 7f4afdc57640 1 -- 172.21.15.52:0/1155553714 wait complete. 2024-09-11T14:38:52.280 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:52.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:38:52.281 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:52.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:38:52.282 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:52.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:38:52.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.440+0000 7f4fc6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.440+0000 7f3b14548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.440+0000 7f18ad8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.440+0000 7fa62d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.446+0000 7f3b14548640 1 Processor -- start 2024-09-11T14:38:52.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7f3b14548640 1 -- start start 2024-09-11T14:38:52.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7f18ad8a3640 1 Processor -- start 2024-09-11T14:38:52.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7fa62d991640 1 Processor -- start 2024-09-11T14:38:52.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7f4fc6791640 1 Processor -- start 2024-09-11T14:38:52.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7fa62d991640 1 -- start start 2024-09-11T14:38:52.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7f18ad8a3640 1 -- start start 2024-09-11T14:38:52.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.447+0000 7f4fc6791640 1 -- start start 2024-09-11T14:38:52.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7fa62d991640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa62809e650 0x7fa628132b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7f18ad8a3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18a8132c40 0x7f18a8137390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7fa62d991640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62809dee0 con 0x7fa6281330c0 2024-09-11T14:38:52.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7fa62d991640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa62806f0c0 con 0x7fa62809e650 2024-09-11T14:38:52.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7f4fc6791640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4fc00a3e10 0x7f4fc00a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7f18ad8a3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a809de40 con 0x7f18a806ece0 2024-09-11T14:38:52.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7f4fc6791640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc006ec50 con 0x7f4fc00a4760 2024-09-11T14:38:52.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7f4fc6791640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc00a6130 con 0x7f4fc00a3e10 2024-09-11T14:38:52.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b14548640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b0c138ef0 0x7f3b0c13b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7fa626ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa62809e650 0x7fa628132b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.448+0000 7f18ad8a3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f18a806e9e0 con 0x7f18a8132c40 2024-09-11T14:38:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f18a6ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f18a806ece0 0x7f18a8132530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48084/0 (socket says 172.21.15.52:48084) 2024-09-11T14:38:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f18a6ffd640 1 -- 172.21.15.52:0/2974454381 learned_addr learned my addr 172.21.15.52:0/2974454381 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b14548640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0c09efe0 con 0x7f3b0c136070 2024-09-11T14:38:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f4fbf7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4fc00a4760 0x7f4fc0135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48096/0 (socket says 172.21.15.52:48096) 2024-09-11T14:38:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f4fbf7fe640 1 -- 172.21.15.52:0/3533300525 learned_addr learned my addr 172.21.15.52:0/3533300525 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7fa626ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa62809e650 0x7fa628132b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40400/0 (socket says 172.21.15.52:40400) 2024-09-11T14:38:52.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7fa626ffd640 1 -- 172.21.15.52:0/2375764973 learned_addr learned my addr 172.21.15.52:0/2375764973 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b14548640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c135c20 con 0x7f3b0c138ef0 2024-09-11T14:38:52.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b122e4640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b0c136070 0x7f3b0c136480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48088/0 (socket says 172.21.15.52:48088) 2024-09-11T14:38:52.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b122e4640 1 -- 172.21.15.52:0/1887716025 learned_addr learned my addr 172.21.15.52:0/1887716025 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:52.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f18a67fc640 1 --2- 172.21.15.52:0/2974454381 >> v2:172.21.15.52:3300/0 conn(0x7f18a8132c40 0x7f18a8137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f4fbffff640 1 --2- 172.21.15.52:0/3533300525 >> v2:172.21.15.52:3300/0 conn(0x7f4fc00a3e10 0x7f4fc00a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b11ae3640 1 --2- 172.21.15.52:0/1887716025 >> v2:172.21.15.52:3300/0 conn(0x7f3b0c138ef0 0x7f3b0c13b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f18a67fc640 1 -- 172.21.15.52:0/2974454381 >> v1:172.21.15.52:6789/0 conn(0x7f18a806ece0 legacy=0x7f18a8132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f18a67fc640 1 -- 172.21.15.52:0/2974454381 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a809db70 con 0x7f18a8132c40 2024-09-11T14:38:52.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530386078 0 0) 0x7f4fc006ec50 con 0x7f4fc00a4760 2024-09-11T14:38:52.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa8003580 con 0x7f4fc00a4760 2024-09-11T14:38:52.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7fa626ffd640 1 -- 172.21.15.52:0/2375764973 >> v1:172.21.15.52:6789/0 conn(0x7fa6281330c0 legacy=0x7fa628135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7fa626ffd640 1 -- 172.21.15.52:0/2375764973 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa628132730 con 0x7fa62809e650 2024-09-11T14:38:52.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b11ae3640 1 -- 172.21.15.52:0/1887716025 >> v1:172.21.15.52:6789/0 conn(0x7f3b0c136070 legacy=0x7f3b0c136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.449+0000 7f3b11ae3640 1 -- 172.21.15.52:0/1887716025 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c09d360 con 0x7f3b0c138ef0 2024-09-11T14:38:52.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f18a67fc640 1 --2- 172.21.15.52:0/2974454381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a8132c40 0x7f18a8137390 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4917f58065326 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f3b11ae3640 1 --2- 172.21.15.52:0/1887716025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c138ef0 0x7f3b0c13b310 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f501d3e6c21ce1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1974909947 0 0) 0x7f4fa8003580 con 0x7f4fc00a4760 2024-09-11T14:38:52.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 >> v2:172.21.15.52:3300/0 conn(0x7f4fc00a3e10 msgr2=0x7f4fc00a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T14:38:52.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 --2- 172.21.15.52:0/3533300525 >> v2:172.21.15.52:3300/0 conn(0x7f4fc00a3e10 0x7f4fc00a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc00a5110 con 0x7f4fc00a4760 2024-09-11T14:38:52.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3793025989 0 0) 0x7f4fb4001620 con 0x7f4fc00a4760 2024-09-11T14:38:52.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f3b112e2640 1 -- 172.21.15.52:0/1887716025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3afc009d80 con 0x7f3b0c138ef0 2024-09-11T14:38:52.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 >> v1:172.21.15.52:6789/0 conn(0x7f4fc00a4760 legacy=0x7f4fc0135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f3b112e2640 1 -- 172.21.15.52:0/1887716025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3afc00e230 con 0x7f3b0c138ef0 2024-09-11T14:38:52.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 --2- 172.21.15.52:0/3533300525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa8003a70 0x7f4fa8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc00a6130 con 0x7f4fa8003a70 2024-09-11T14:38:52.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7fa626ffd640 1 --2- 172.21.15.52:0/2375764973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa62809e650 0x7fa628132b80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c52b49de27d1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f3b112e2640 1 -- 172.21.15.52:0/1887716025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3afc00e4d0 con 0x7f3b0c138ef0 2024-09-11T14:38:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f18a5ffb640 1 -- 172.21.15.52:0/2974454381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f189c00ad10 con 0x7f18a8132c40 2024-09-11T14:38:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f4fbffff640 1 --2- 172.21.15.52:0/3533300525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa8003a70 0x7f4fa8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7fa625ffb640 1 -- 172.21.15.52:0/2375764973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa618009e50 con 0x7fa62809e650 2024-09-11T14:38:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f18a5ffb640 1 -- 172.21.15.52:0/2974454381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f189c00ae70 con 0x7f18a8132c40 2024-09-11T14:38:52.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7f18a5ffb640 1 -- 172.21.15.52:0/2974454381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f189c00ad10 con 0x7f18a8132c40 2024-09-11T14:38:52.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.450+0000 7fa625ffb640 1 -- 172.21.15.52:0/2375764973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa61800e230 con 0x7fa62809e650 2024-09-11T14:38:52.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7fa625ffb640 1 -- 172.21.15.52:0/2375764973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa61800e4d0 con 0x7fa62809e650 2024-09-11T14:38:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f4fbffff640 1 -- 172.21.15.52:0/3533300525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa8003580 con 0x7f4fa8003a70 2024-09-11T14:38:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f4fbffff640 1 --2- 172.21.15.52:0/3533300525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa8003a70 0x7f4fa8003ec0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638243216c02f8da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4fb00096f0 con 0x7f4fa8003a70 2024-09-11T14:38:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4fb0009d90 con 0x7f4fa8003a70 2024-09-11T14:38:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f3b14548640 1 -- 172.21.15.52:0/1887716025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c138ef0 msgr2=0x7f3b0c13b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f4fbeffd640 1 -- 172.21.15.52:0/3533300525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4fb0011450 con 0x7f4fa8003a70 2024-09-11T14:38:52.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f3b14548640 1 --2- 172.21.15.52:0/1887716025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c138ef0 0x7f3b0c13b310 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7fa62d991640 1 -- 172.21.15.52:0/2375764973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa62809e650 msgr2=0x7fa628132b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7fa62d991640 1 --2- 172.21.15.52:0/2375764973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa62809e650 0x7fa628132b80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f18ad8a3640 1 -- 172.21.15.52:0/2974454381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a8132c40 msgr2=0x7f18a8137390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f18ad8a3640 1 --2- 172.21.15.52:0/2974454381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a8132c40 0x7f18a8137390 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f3b14548640 1 -- 172.21.15.52:0/1887716025 shutdown_connections 2024-09-11T14:38:52.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f3b14548640 1 --2- 172.21.15.52:0/1887716025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c138ef0 0x7f3b0c13b310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f3b14548640 1 -- 172.21.15.52:0/1887716025 >> 172.21.15.52:0/1887716025 conn(0x7f3b0c06eb10 msgr2=0x7f3b0c06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f18ad8a3640 1 -- 172.21.15.52:0/2974454381 shutdown_connections 2024-09-11T14:38:52.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7f18ad8a3640 1 --2- 172.21.15.52:0/2974454381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a8132c40 0x7f18a8137390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7fa62d991640 1 -- 172.21.15.52:0/2375764973 shutdown_connections 2024-09-11T14:38:52.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f18ad8a3640 1 -- 172.21.15.52:0/2974454381 >> 172.21.15.52:0/2974454381 conn(0x7f18a80a1bd0 msgr2=0x7f18a80a2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.451+0000 7fa62d991640 1 --2- 172.21.15.52:0/2375764973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa62809e650 0x7fa628132b80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7fa62d991640 1 -- 172.21.15.52:0/2375764973 >> 172.21.15.52:0/2375764973 conn(0x7fa6280a1bd0 msgr2=0x7fa6280a2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f3b14548640 1 -- 172.21.15.52:0/1887716025 shutdown_connections 2024-09-11T14:38:52.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f3b14548640 1 -- 172.21.15.52:0/1887716025 wait complete. 2024-09-11T14:38:52.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f18ad8a3640 1 -- 172.21.15.52:0/2974454381 shutdown_connections 2024-09-11T14:38:52.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7fa62d991640 1 -- 172.21.15.52:0/2375764973 shutdown_connections 2024-09-11T14:38:52.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7fa62d991640 1 -- 172.21.15.52:0/2375764973 wait complete. 2024-09-11T14:38:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f18ad8a3640 1 -- 172.21.15.52:0/2974454381 wait complete. 2024-09-11T14:38:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7fa62d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f3b14548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f18ad8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 -- 172.21.15.52:0/3533300525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa8003a70 msgr2=0x7f4fa8003ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 --2- 172.21.15.52:0/3533300525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa8003a70 0x7f4fa8003ec0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 -- 172.21.15.52:0/3533300525 shutdown_connections 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 --2- 172.21.15.52:0/3533300525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa8003a70 0x7f4fa8003ec0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 --2- 172.21.15.52:0/3533300525 >> v2:172.21.15.52:3300/0 conn(0x7f4fc00a3e10 0x7f4fc00a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 -- 172.21.15.52:0/3533300525 >> 172.21.15.52:0/3533300525 conn(0x7f4fc00a74f0 msgr2=0x7f4fc00a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.452+0000 7f4fc6791640 1 -- 172.21.15.52:0/3533300525 shutdown_connections 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.453+0000 7f4fc6791640 1 -- 172.21.15.52:0/3533300525 wait complete. 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.453+0000 7f4fc6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.454+0000 7fa62d991640 1 Processor -- start 2024-09-11T14:38:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.454+0000 7f3b14548640 1 Processor -- start 2024-09-11T14:38:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.454+0000 7f3b14548640 1 -- start start 2024-09-11T14:38:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.454+0000 7fa62d991640 1 -- start start 2024-09-11T14:38:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.454+0000 7f18ad8a3640 1 Processor -- start 2024-09-11T14:38:52.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.454+0000 7f4fc6791640 1 Processor -- start 2024-09-11T14:38:52.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.455+0000 7f18ad8a3640 1 -- start start 2024-09-11T14:38:52.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.455+0000 7f4fc6791640 1 -- start start 2024-09-11T14:38:52.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f3b14548640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 0x7f3b0c120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7fa62d991640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 0x7fa628072620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f3b14548640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c1207a0 con 0x7f3b0c136070 2024-09-11T14:38:52.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7fa62d991640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa628073760 con 0x7fa6281330c0 2024-09-11T14:38:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f3b122e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 0x7f3b0c120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7fa626ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 0x7fa628072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7fa626ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 0x7fa628072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40446/0 (socket says 172.21.15.52:40446) 2024-09-11T14:38:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7fa626ffd640 1 -- 172.21.15.52:0/750991106 learned_addr learned my addr 172.21.15.52:0/750991106 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f3b122e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 0x7f3b0c120bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40444/0 (socket says 172.21.15.52:40444) 2024-09-11T14:38:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f3b122e4640 1 -- 172.21.15.52:0/4184957220 learned_addr learned my addr 172.21.15.52:0/4184957220 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f18ad8a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 0x7f18a8120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f18ad8a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8122fd0 con 0x7f18a806ece0 2024-09-11T14:38:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f18a6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 0x7f18a8120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f4fc6791640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 0x7f4fc0126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f18a6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 0x7f18a8120d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40462/0 (socket says 172.21.15.52:40462) 2024-09-11T14:38:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f18a6ffd640 1 -- 172.21.15.52:0/1761469100 learned_addr learned my addr 172.21.15.52:0/1761469100 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7fa626ffd640 1 -- 172.21.15.52:0/750991106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa628073fc0 con 0x7fa6281330c0 2024-09-11T14:38:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.456+0000 7f3b122e4640 1 -- 172.21.15.52:0/4184957220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c124060 con 0x7f3b0c136070 2024-09-11T14:38:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f4fc6791640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc0125790 con 0x7f4fc00a3e10 2024-09-11T14:38:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f3b122e4640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 0x7f3b0c120bf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 0x7f4fc0126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 0x7f4fc0126040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40470/0 (socket says 172.21.15.52:40470) 2024-09-11T14:38:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f4fbffff640 1 -- 172.21.15.52:0/1153716672 learned_addr learned my addr 172.21.15.52:0/1153716672 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b08005a60 con 0x7f3b0c136070 2024-09-11T14:38:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b08005bc0 con 0x7f3b0c136070 2024-09-11T14:38:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c1223e0 con 0x7f3b0c136070 2024-09-11T14:38:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f18a6ffd640 1 -- 172.21.15.52:0/1761469100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a8122040 con 0x7f18a806ece0 2024-09-11T14:38:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f4fbffff640 1 -- 172.21.15.52:0/1153716672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc0125d20 con 0x7f4fc00a3e10 2024-09-11T14:38:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f18a6ffd640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 0x7f18a8120d00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7fa626ffd640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 0x7fa628072620 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f4fbffff640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 0x7f4fc0126040 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b08005e60 con 0x7f3b0c136070 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c1200f0 con 0x7f3b0c136070 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa61800eda0 con 0x7fa6281330c0 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa618015420 con 0x7fa6281330c0 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa6180156c0 con 0x7fa6281330c0 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6281204e0 con 0x7fa6281330c0 2024-09-11T14:38:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62811f710 con 0x7fa6281330c0 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.457+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1898005a60 con 0x7f18a806ece0 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a8124ce0 con 0x7f18a806ece0 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a80a0a20 con 0x7f18a806ece0 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1898005bc0 con 0x7f18a806ece0 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4fb0006e30 con 0x7f4fc00a3e10 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4fb0014410 con 0x7f4fc00a3e10 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc0127b70 con 0x7f4fc00a3e10 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4fb0006e30 con 0x7f4fc00a3e10 2024-09-11T14:38:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc0125980 con 0x7f4fc00a3e10 2024-09-11T14:38:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.458+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3b080070b0 con 0x7f3b0c136070 2024-09-11T14:38:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f3b02ffd640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3af003e930 0x7f3af0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f3b0804f700 con 0x7f3b0c136070 2024-09-11T14:38:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1898005a60 con 0x7f18a806ece0 2024-09-11T14:38:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c06a460 con 0x7f3b0c136070 2024-09-11T14:38:52.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62809e650 con 0x7fa6281330c0 2024-09-11T14:38:52.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18880050f0 con 0x7f18a806ece0 2024-09-11T14:38:52.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.459+0000 7f3b11ae3640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3af003e930 0x7f3af0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7f3b11ae3640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3af003e930 0x7f3af0040e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa618015820 con 0x7fa6281330c0 2024-09-11T14:38:52.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc00a56d0 con 0x7f4fc00a3e10 2024-09-11T14:38:52.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4fb0014700 con 0x7f4fc00a3e10 2024-09-11T14:38:52.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f189800c7f0 con 0x7f18a806ece0 2024-09-11T14:38:52.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7fa60ffff640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fa61403e980 0x7fa614040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.460+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fa618050eb0 con 0x7fa6281330c0 2024-09-11T14:38:52.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7f4fbcff9640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4fac03e950 0x7f4fac040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7fa6267fc640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fa61403e980 0x7fa614040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7f188ffff640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f189403e920 0x7f1894040e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:52.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7f4fbf7fe640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4fac03e950 0x7f4fac040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7f18a67fc640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f189403e920 0x7f1894040e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:52.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7fa6267fc640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fa61403e980 0x7fa614040e90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.461+0000 7f4fbf7fe640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4fac03e950 0x7f4fac040e60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.462+0000 7f18a67fc640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f189403e920 0x7f1894040e30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:52.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.465+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f4fb001a040 con 0x7f4fc00a3e10 2024-09-11T14:38:52.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.465+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f189800a980 con 0x7f18a806ece0 2024-09-11T14:38:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.466+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3b0800dc10 con 0x7f3b0c136070 2024-09-11T14:38:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.471+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa618014c60 con 0x7fa6281330c0 2024-09-11T14:38:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.476+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f18980102a0 con 0x7f18a806ece0 2024-09-11T14:38:52.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.482+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4fb0013cb0 con 0x7f4fc00a3e10 2024-09-11T14:38:52.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.666+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1888005670 con 0x7f18a806ece0 2024-09-11T14:38:52.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.666+0000 7f188ffff640 1 -- 172.21.15.52:0/1761469100 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f18980102a0 con 0x7f18a806ece0 2024-09-11T14:38:52.668 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f189403e920 msgr2=0x7f1894040e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f189403e920 0x7f1894040e30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 msgr2=0x7f18a8120d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 0x7f18a8120d00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 shutdown_connections 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f189403e920 0x7f1894040e30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 --2- 172.21.15.52:0/1761469100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a806ece0 0x7f18a8120d00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.668+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 >> 172.21.15.52:0/1761469100 conn(0x7f18a80a1bd0 msgr2=0x7f18a80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.669+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 shutdown_connections 2024-09-11T14:38:52.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.669+0000 7f18ad8a3640 1 -- 172.21.15.52:0/1761469100 wait complete. 2024-09-11T14:38:52.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.672+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4fc0077360 con 0x7f4fc00a3e10 2024-09-11T14:38:52.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.673+0000 7f4fbcff9640 1 -- 172.21.15.52:0/1153716672 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f4fb0013cb0 con 0x7f4fc00a3e10 2024-09-11T14:38:52.674 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4fac03e950 msgr2=0x7f4fac040e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4fac03e950 0x7f4fac040e60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 msgr2=0x7f4fc0126040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 0x7f4fc0126040 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 shutdown_connections 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4fac03e950 0x7f4fac040e60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 --2- 172.21.15.52:0/1153716672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc00a3e10 0x7f4fc0126040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.676+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 >> 172.21.15.52:0/1153716672 conn(0x7f4fc00a74f0 msgr2=0x7f4fc011ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.677+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 shutdown_connections 2024-09-11T14:38:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.677+0000 7f4fc6791640 1 -- 172.21.15.52:0/1153716672 wait complete. 2024-09-11T14:38:52.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.2 2024-09-11T14:38:52.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.681+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3b0c09d600 con 0x7f3b0c136070 2024-09-11T14:38:52.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.682+0000 7f3b02ffd640 1 -- 172.21.15.52:0/4184957220 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f3b0800d610 con 0x7f3b0c136070 2024-09-11T14:38:52.683 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-09-11T14:38:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3af003e930 msgr2=0x7f3af0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3af003e930 0x7f3af0040e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 msgr2=0x7f3b0c120bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 0x7f3b0c120bf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 shutdown_connections 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3af003e930 0x7f3af0040e40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 --2- 172.21.15.52:0/4184957220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0c136070 0x7f3b0c120bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 >> 172.21.15.52:0/4184957220 conn(0x7f3b0c06eb10 msgr2=0x7f3b0c0a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 shutdown_connections 2024-09-11T14:38:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.684+0000 7f3b14548640 1 -- 172.21.15.52:0/4184957220 wait complete. 2024-09-11T14:38:52.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.3 2024-09-11T14:38:52.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.695+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa62806a000 con 0x7fa6281330c0 2024-09-11T14:38:52.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.1 2024-09-11T14:38:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.695+0000 7fa60ffff640 1 -- 172.21.15.52:0/750991106 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fa6180129e0 con 0x7fa6281330c0 2024-09-11T14:38:52.697 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fa61403e980 msgr2=0x7fa614040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fa61403e980 0x7fa614040e90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 msgr2=0x7fa628072620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 0x7fa628072620 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 shutdown_connections 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fa61403e980 0x7fa614040e90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 --2- 172.21.15.52:0/750991106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6281330c0 0x7fa628072620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 >> 172.21.15.52:0/750991106 conn(0x7fa6280a1bd0 msgr2=0x7fa62809ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:52.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 shutdown_connections 2024-09-11T14:38:52.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:52.697+0000 7fa62d991640 1 -- 172.21.15.52:0/750991106 wait complete. 2024-09-11T14:38:52.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705668 for osd.0 2024-09-11T14:38:53.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:38:53.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:38:53.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:38:53.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:38:53.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.802+0000 7eff68e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.811+0000 7eff68e7f640 1 Processor -- start 2024-09-11T14:38:53.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.811+0000 7eff68e7f640 1 -- start start 2024-09-11T14:38:53.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.814+0000 7eff68e7f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff640a4930 0x7eff6413b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.814+0000 7eff68e7f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6406ec50 con 0x7eff640a3e10 2024-09-11T14:38:53.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.814+0000 7eff68e7f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7eff640a6130 con 0x7eff640a4930 2024-09-11T14:38:53.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.814+0000 7eff6259c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7eff640a3e10 0x7eff640a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43394/0 (socket says 172.21.15.52:43394) 2024-09-11T14:38:53.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.814+0000 7eff61d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7eff640a4930 0x7eff6413b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.814+0000 7eff6259c640 1 -- 172.21.15.52:0/1138737536 learned_addr learned my addr 172.21.15.52:0/1138737536 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.815+0000 7eff61d9b640 1 -- 172.21.15.52:0/1138737536 >> v1:172.21.15.52:6789/0 conn(0x7eff640a3e10 legacy=0x7eff640a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.815+0000 7eff61d9b640 1 -- 172.21.15.52:0/1138737536 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff640a5110 con 0x7eff640a4930 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.815+0000 7eff6159a640 1 -- 172.21.15.52:0/1138737536 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264442545 0 0) 0x7eff6406ec50 con 0x7eff640a3e10 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.815+0000 7eff61d9b640 1 --2- 172.21.15.52:0/1138737536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a4930 0x7eff6413b2d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846567f0a982705e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.815+0000 7eff6159a640 1 -- 172.21.15.52:0/1138737536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff58009d90 con 0x7eff640a4930 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.816+0000 7eff6159a640 1 -- 172.21.15.52:0/1138737536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7eff5800e230 con 0x7eff640a4930 2024-09-11T14:38:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.816+0000 7eff6159a640 1 -- 172.21.15.52:0/1138737536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff5800e4d0 con 0x7eff640a4930 2024-09-11T14:38:53.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 -- 172.21.15.52:0/1138737536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a4930 msgr2=0x7eff6413b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 --2- 172.21.15.52:0/1138737536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a4930 0x7eff6413b2d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 -- 172.21.15.52:0/1138737536 shutdown_connections 2024-09-11T14:38:53.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 --2- 172.21.15.52:0/1138737536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a4930 0x7eff6413b2d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 -- 172.21.15.52:0/1138737536 >> 172.21.15.52:0/1138737536 conn(0x7eff640a74f0 msgr2=0x7eff640a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:53.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 -- 172.21.15.52:0/1138737536 shutdown_connections 2024-09-11T14:38:53.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 1 -- 172.21.15.52:0/1138737536 wait complete. 2024-09-11T14:38:53.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.817+0000 7eff68e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.819+0000 7eff68e7f640 1 Processor -- start 2024-09-11T14:38:53.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.820+0000 7eff68e7f640 1 -- start start 2024-09-11T14:38:53.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.822+0000 7eff68e7f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 0x7eff64124230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.822+0000 7eff68e7f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff64125b10 con 0x7eff640a3e10 2024-09-11T14:38:53.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.822+0000 7eff6259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 0x7eff64124230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.822+0000 7eff6259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 0x7eff64124230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34382/0 (socket says 172.21.15.52:34382) 2024-09-11T14:38:53.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.822+0000 7eff6259c640 1 -- 172.21.15.52:0/3211821639 learned_addr learned my addr 172.21.15.52:0/3211821639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:53.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff6259c640 1 -- 172.21.15.52:0/3211821639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff64123de0 con 0x7eff640a3e10 2024-09-11T14:38:53.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff6259c640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 0x7eff64124230 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff54004b80 con 0x7eff640a3e10 2024-09-11T14:38:53.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7eff54004ce0 con 0x7eff640a3e10 2024-09-11T14:38:53.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff641252d0 con 0x7eff640a3e10 2024-09-11T14:38:53.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff54007120 con 0x7eff640a3e10 2024-09-11T14:38:53.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.823+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff64127750 con 0x7eff640a3e10 2024-09-11T14:38:53.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.825+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff640a56d0 con 0x7eff640a3e10 2024-09-11T14:38:53.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.825+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7eff540072d0 con 0x7eff640a3e10 2024-09-11T14:38:53.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.825+0000 7eff52ffd640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7eff4403e930 0x7eff44040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.826+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7eff5404f800 con 0x7eff640a3e10 2024-09-11T14:38:53.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.826+0000 7eff61d9b640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7eff4403e930 0x7eff44040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.827+0000 7eff61d9b640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7eff4403e930 0x7eff44040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.831+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7eff5400f230 con 0x7eff640a3e10 2024-09-11T14:38:53.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.847+0000 7f97b1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.847+0000 7fb7c8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.854+0000 7fb7c8951640 1 Processor -- start 2024-09-11T14:38:53.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.854+0000 7f97b1abd640 1 Processor -- start 2024-09-11T14:38:53.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.854+0000 7fb7c8951640 1 -- start start 2024-09-11T14:38:53.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.854+0000 7f97b1abd640 1 -- start start 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c8951640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7c40a4930 0x7fb7c413b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c8951640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c406ec50 con 0x7fb7c40a3e10 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c8951640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c40a6130 con 0x7fb7c40a4930 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c1d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7c40a4930 0x7fb7c413b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c259c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb7c40a3e10 0x7fb7c40a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43402/0 (socket says 172.21.15.52:43402) 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c259c640 1 -- 172.21.15.52:0/3836140037 learned_addr learned my addr 172.21.15.52:0/3836140037 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c1d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7c40a4930 0x7fb7c413b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34398/0 (socket says 172.21.15.52:34398) 2024-09-11T14:38:53.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c1d9b640 1 -- 172.21.15.52:0/3836140037 >> v1:172.21.15.52:6789/0 conn(0x7fb7c40a3e10 legacy=0x7fb7c40a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.856+0000 7fb7c159a640 1 -- 172.21.15.52:0/3836140037 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186368662 0 0) 0x7fb7c406ec50 con 0x7fb7c40a3e10 2024-09-11T14:38:53.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7fb7c1d9b640 1 -- 172.21.15.52:0/3836140037 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c40a5110 con 0x7fb7c40a4930 2024-09-11T14:38:53.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97b1abd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97ac136e60 0x7f97ac139280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97b1abd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ac09deb0 con 0x7f97ac134010 2024-09-11T14:38:53.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97ab7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f97ac134010 0x7f97ac134420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43418/0 (socket says 172.21.15.52:43418) 2024-09-11T14:38:53.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97ab7fe640 1 -- 172.21.15.52:0/2789448568 learned_addr learned my addr 172.21.15.52:0/2789448568 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:53.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97aaffd640 1 --2- 172.21.15.52:0/2789448568 >> v2:172.21.15.52:3300/0 conn(0x7f97ac136e60 0x7f97ac139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7fb7c1d9b640 1 --2- 172.21.15.52:0/3836140037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a4930 0x7fb7c413b2d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f79b2451f68e398 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97b1abd640 1 -- 172.21.15.52:0/2789448568 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f97ac0a5b20 con 0x7f97ac136e60 2024-09-11T14:38:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7fb7c159a640 1 -- 172.21.15.52:0/3836140037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7b8009d90 con 0x7fb7c40a4930 2024-09-11T14:38:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7fb7c159a640 1 -- 172.21.15.52:0/3836140037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb7b800e230 con 0x7fb7c40a4930 2024-09-11T14:38:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7fb7c159a640 1 -- 172.21.15.52:0/3836140037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7b800e4d0 con 0x7fb7c40a4930 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97aa7fc640 1 -- 172.21.15.52:0/2789448568 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593345051 0 0) 0x7f97ac09deb0 con 0x7f97ac134010 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.857+0000 7f97aa7fc640 1 -- 172.21.15.52:0/2789448568 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9794003580 con 0x7f97ac134010 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7f97aaffd640 1 -- 172.21.15.52:0/2789448568 >> v1:172.21.15.52:6789/0 conn(0x7f97ac134010 legacy=0x7f97ac134420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7f97aaffd640 1 -- 172.21.15.52:0/2789448568 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac0a5cf0 con 0x7f97ac136e60 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7f97aaffd640 1 --2- 172.21.15.52:0/2789448568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac136e60 0x7f97ac139280 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838706541d47647 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7f97aa7fc640 1 -- 172.21.15.52:0/2789448568 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97a0009d90 con 0x7f97ac136e60 2024-09-11T14:38:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7f97aa7fc640 1 -- 172.21.15.52:0/2789448568 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f97a000e230 con 0x7f97ac136e60 2024-09-11T14:38:53.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7f97aa7fc640 1 -- 172.21.15.52:0/2789448568 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97a000e4d0 con 0x7f97ac136e60 2024-09-11T14:38:53.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 -- 172.21.15.52:0/3836140037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a4930 msgr2=0x7fb7c413b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 --2- 172.21.15.52:0/3836140037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a4930 0x7fb7c413b2d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 -- 172.21.15.52:0/3836140037 shutdown_connections 2024-09-11T14:38:53.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 --2- 172.21.15.52:0/3836140037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a4930 0x7fb7c413b2d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 -- 172.21.15.52:0/3836140037 >> 172.21.15.52:0/3836140037 conn(0x7fb7c40a74f0 msgr2=0x7fb7c40a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:53.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 -- 172.21.15.52:0/3836140037 shutdown_connections 2024-09-11T14:38:53.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.858+0000 7fb7c8951640 1 -- 172.21.15.52:0/3836140037 wait complete. 2024-09-11T14:38:53.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7fb7c8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7f97b1abd640 1 -- 172.21.15.52:0/2789448568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac136e60 msgr2=0x7f97ac139280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7f97b1abd640 1 --2- 172.21.15.52:0/2789448568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac136e60 0x7f97ac139280 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7f97b1abd640 1 -- 172.21.15.52:0/2789448568 shutdown_connections 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7f97b1abd640 1 --2- 172.21.15.52:0/2789448568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac136e60 0x7f97ac139280 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7f97b1abd640 1 -- 172.21.15.52:0/2789448568 >> 172.21.15.52:0/2789448568 conn(0x7f97ac0a43e0 msgr2=0x7f97ac073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.859+0000 7f97b1abd640 1 -- 172.21.15.52:0/2789448568 shutdown_connections 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.860+0000 7f97b1abd640 1 -- 172.21.15.52:0/2789448568 wait complete. 2024-09-11T14:38:53.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.860+0000 7f97b1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.853+0000 7f4611274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.862+0000 7fb7c8951640 1 Processor -- start 2024-09-11T14:38:53.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.862+0000 7fb7c8951640 1 -- start start 2024-09-11T14:38:53.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.862+0000 7f4611274640 1 Processor -- start 2024-09-11T14:38:53.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.862+0000 7f4611274640 1 -- start start 2024-09-11T14:38:53.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.863+0000 7f97b1abd640 1 Processor -- start 2024-09-11T14:38:53.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.863+0000 7f97b1abd640 1 -- start start 2024-09-11T14:38:53.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.864+0000 7fb7c8951640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 0x7fb7c4123f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f4611274640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460c0a3e10 0x7f460c0a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f4611274640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460c06ec50 con 0x7f460c0a4760 2024-09-11T14:38:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f4611274640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f460c0a6130 con 0x7f460c0a3e10 2024-09-11T14:38:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7fb7c8951640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c4126070 con 0x7fb7c40a3e10 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460c0a3e10 0x7f460c0a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460a7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f460c0a4760 0x7f460c135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43420/0 (socket says 172.21.15.52:43420) 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460c0a3e10 0x7f460c0a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34426/0 (socket says 172.21.15.52:34426) 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460a7fc640 1 -- 172.21.15.52:0/2909442326 learned_addr learned my addr 172.21.15.52:0/2909442326 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7fb7c259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 0x7fb7c4123f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7fb7c259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 0x7fb7c4123f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34424/0 (socket says 172.21.15.52:34424) 2024-09-11T14:38:53.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7fb7c259c640 1 -- 172.21.15.52:0/2954584717 learned_addr learned my addr 172.21.15.52:0/2954584717 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:53.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460affd640 1 -- 172.21.15.52:0/2909442326 >> v1:172.21.15.52:6789/0 conn(0x7f460c0a4760 legacy=0x7f460c135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f4609ffb640 1 -- 172.21.15.52:0/2909442326 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106571198 0 0) 0x7f460c06ec50 con 0x7f460c0a4760 2024-09-11T14:38:53.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460affd640 1 -- 172.21.15.52:0/2909442326 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c0a5110 con 0x7f460c0a3e10 2024-09-11T14:38:53.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7fb7c259c640 1 -- 172.21.15.52:0/2954584717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c41238e0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.865+0000 7f460affd640 1 --2- 172.21.15.52:0/2909442326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c0a4220 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46498980729fcf57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97b1abd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 0x7f97ac1c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97b1abd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1224d0 con 0x7f97ac134010 2024-09-11T14:38:53.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f4609ffb640 1 -- 172.21.15.52:0/2909442326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45fc009d90 con 0x7f460c0a3e10 2024-09-11T14:38:53.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7fb7c259c640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 0x7fb7c4123f90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f4609ffb640 1 -- 172.21.15.52:0/2909442326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f45fc00e230 con 0x7f460c0a3e10 2024-09-11T14:38:53.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 0x7f97ac1c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f4609ffb640 1 -- 172.21.15.52:0/2909442326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45fc00e4d0 con 0x7f460c0a3e10 2024-09-11T14:38:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 0x7f97ac1c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34436/0 (socket says 172.21.15.52:34436) 2024-09-11T14:38:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97ab7fe640 1 -- 172.21.15.52:0/985487566 learned_addr learned my addr 172.21.15.52:0/985487566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7b4004b80 con 0x7fb7c40a3e10 2024-09-11T14:38:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97ab7fe640 1 -- 172.21.15.52:0/985487566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac11e870 con 0x7f97ac134010 2024-09-11T14:38:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7f97ab7fe640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 0x7f97ac1c62a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f979c005a60 con 0x7f97ac134010 2024-09-11T14:38:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f979c005bc0 con 0x7f97ac134010 2024-09-11T14:38:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f979c005e60 con 0x7f97ac134010 2024-09-11T14:38:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb7b4004ce0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c4123bf0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7b4007120 con 0x7fb7c40a3e10 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.866+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c4126bb0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f4611274640 1 -- 172.21.15.52:0/2909442326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 msgr2=0x7f460c0a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f4611274640 1 --2- 172.21.15.52:0/2909442326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c0a4220 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f4611274640 1 -- 172.21.15.52:0/2909442326 shutdown_connections 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f4611274640 1 --2- 172.21.15.52:0/2909442326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c0a4220 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:53.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f4611274640 1 -- 172.21.15.52:0/2909442326 >> 172.21.15.52:0/2909442326 conn(0x7f460c0a74f0 msgr2=0x7f460c0a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:53.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac11ff70 con 0x7f97ac134010 2024-09-11T14:38:53.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac11e4d0 con 0x7f97ac134010 2024-09-11T14:38:53.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.867+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c4125ec0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7f4611274640 1 -- 172.21.15.52:0/2909442326 shutdown_connections 2024-09-11T14:38:53.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7f4611274640 1 -- 172.21.15.52:0/2909442326 wait complete. 2024-09-11T14:38:53.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7f4611274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:53.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb7b40072d0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7fb7b2ffd640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb7a403e980 0x7fb7a4040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fb7b404f8b0 con 0x7fb7c40a3e10 2024-09-11T14:38:53.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.868+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac06ab50 con 0x7f97ac134010 2024-09-11T14:38:53.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.869+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f979c0070b0 con 0x7f97ac134010 2024-09-11T14:38:53.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.869+0000 7fb7c1d9b640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb7a403e980 0x7fb7a4040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.869+0000 7f9793fff640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f979803e9b0 0x7f9798040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.869+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f979c04f660 con 0x7f97ac134010 2024-09-11T14:38:53.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.869+0000 7fb7c1d9b640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb7a403e980 0x7fb7a4040e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.870+0000 7f97aaffd640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f979803e9b0 0x7f9798040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.870+0000 7f97aaffd640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f979803e9b0 0x7f9798040ec0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.871+0000 7f4611274640 1 Processor -- start 2024-09-11T14:38:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.872+0000 7f4611274640 1 -- start start 2024-09-11T14:38:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.874+0000 7f4611274640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c123aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.874+0000 7f4611274640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f460c124f40 con 0x7f460c0a3e10 2024-09-11T14:38:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.874+0000 7f460affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c123aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.874+0000 7f460affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c123aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34444/0 (socket says 172.21.15.52:34444) 2024-09-11T14:38:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.874+0000 7f460affd640 1 -- 172.21.15.52:0/3937278891 learned_addr learned my addr 172.21.15.52:0/3937278891 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.875+0000 7f460affd640 1 -- 172.21.15.52:0/3937278891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c125520 con 0x7f460c0a3e10 2024-09-11T14:38:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.875+0000 7f460affd640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c123aa0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.877+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb7b400f230 con 0x7fb7c40a3e10 2024-09-11T14:38:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.886+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45fc014540 con 0x7f460c0a3e10 2024-09-11T14:38:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.886+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f979c00dc60 con 0x7f97ac134010 2024-09-11T14:38:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.886+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f45fc0146a0 con 0x7f460c0a3e10 2024-09-11T14:38:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.886+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45fc014940 con 0x7f460c0a3e10 2024-09-11T14:38:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.887+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460c124c30 con 0x7f460c0a3e10 2024-09-11T14:38:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.887+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460c126340 con 0x7f460c0a3e10 2024-09-11T14:38:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.888+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f45fc014af0 con 0x7f460c0a3e10 2024-09-11T14:38:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.888+0000 7f45f37fe640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45f803e930 0x7f45f8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.888+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f45fc019040 con 0x7f460c0a3e10 2024-09-11T14:38:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.889+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f460c0a56d0 con 0x7f460c0a3e10 2024-09-11T14:38:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.889+0000 7f460a7fc640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45f803e930 0x7f45f8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.889+0000 7f460a7fc640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45f803e930 0x7f45f8040e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:53.899+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f45fc00e3a0 con 0x7f460c0a3e10 2024-09-11T14:38:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.040+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7eff64077360 con 0x7eff640a3e10 2024-09-11T14:38:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.040+0000 7eff52ffd640 1 -- 172.21.15.52:0/3211821639 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7eff5400a0c0 con 0x7eff640a3e10 2024-09-11T14:38:54.041 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7eff4403e930 msgr2=0x7eff44040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7eff4403e930 0x7eff44040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 msgr2=0x7eff64124230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 0x7eff64124230 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 shutdown_connections 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7eff4403e930 0x7eff44040e40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 --2- 172.21.15.52:0/3211821639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff640a3e10 0x7eff64124230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 >> 172.21.15.52:0/3211821639 conn(0x7eff640a74f0 msgr2=0x7eff64071390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 shutdown_connections 2024-09-11T14:38:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.042+0000 7eff68e7f640 1 -- 172.21.15.52:0/3211821639 wait complete. 2024-09-11T14:38:54.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-11T14:38:54.055 DEBUG:teuthology.parallel:result is None 2024-09-11T14:38:54.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.072+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb7c40a56d0 con 0x7fb7c40a3e10 2024-09-11T14:38:54.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.073+0000 7fb7b2ffd640 1 -- 172.21.15.52:0/2954584717 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fb7b40067b0 con 0x7fb7c40a3e10 2024-09-11T14:38:54.074 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:54.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb7a403e980 msgr2=0x7fb7a4040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb7a403e980 0x7fb7a4040e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 msgr2=0x7fb7c4123f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 0x7fb7c4123f90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 shutdown_connections 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb7a403e980 0x7fb7a4040e90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 --2- 172.21.15.52:0/2954584717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c40a3e10 0x7fb7c4123f90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 >> 172.21.15.52:0/2954584717 conn(0x7fb7c40a74f0 msgr2=0x7fb7c40712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 shutdown_connections 2024-09-11T14:38:54.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.075+0000 7fb7c8951640 1 -- 172.21.15.52:0/2954584717 wait complete. 2024-09-11T14:38:54.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.079+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f97ac134420 con 0x7f97ac134010 2024-09-11T14:38:54.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.080+0000 7f9793fff640 1 -- 172.21.15.52:0/985487566 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f979c00d660 con 0x7f97ac134010 2024-09-11T14:38:54.081 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:54.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f979803e9b0 msgr2=0x7f9798040ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f979803e9b0 0x7f9798040ec0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 msgr2=0x7f97ac1c62a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 0x7f97ac1c62a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 shutdown_connections 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f979803e9b0 0x7f9798040ec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 --2- 172.21.15.52:0/985487566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac134010 0x7f97ac1c62a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 >> 172.21.15.52:0/985487566 conn(0x7f97ac0a43e0 msgr2=0x7f97ac0a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 shutdown_connections 2024-09-11T14:38:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.082+0000 7f97b1abd640 1 -- 172.21.15.52:0/985487566 wait complete. 2024-09-11T14:38:54.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-09-11T14:38:54.088 DEBUG:teuthology.parallel:result is None 2024-09-11T14:38:54.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2024-09-11T14:38:54.095 DEBUG:teuthology.parallel:result is None 2024-09-11T14:38:54.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.098+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f460c06e3b0 con 0x7f460c0a3e10 2024-09-11T14:38:54.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.098+0000 7f45f37fe640 1 -- 172.21.15.52:0/3937278891 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f45fc00f2a0 con 0x7f460c0a3e10 2024-09-11T14:38:54.100 INFO:teuthology.orchestra.run.smithi052.stdout:38654705672 2024-09-11T14:38:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45f803e930 msgr2=0x7f45f8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45f803e930 0x7f45f8040e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 msgr2=0x7f460c123aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c123aa0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 shutdown_connections 2024-09-11T14:38:54.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45f803e930 0x7f45f8040e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 --2- 172.21.15.52:0/3937278891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c0a3e10 0x7f460c123aa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 >> 172.21.15.52:0/3937278891 conn(0x7f460c0a74f0 msgr2=0x7f460c0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 shutdown_connections 2024-09-11T14:38:54.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.101+0000 7f4611274640 1 -- 172.21.15.52:0/3937278891 wait complete. 2024-09-11T14:38:54.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-11T14:38:54.113 DEBUG:teuthology.parallel:result is None 2024-09-11T14:38:54.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:38:54.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.262+0000 7fd933293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.267+0000 7fd933293640 1 Processor -- start 2024-09-11T14:38:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.267+0000 7fd933293640 1 -- start start 2024-09-11T14:38:54.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.268+0000 7fd933293640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd92c0a4930 0x7fd92c13b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd933293640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd92c06ec50 con 0x7fd92c0a3e10 2024-09-11T14:38:54.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd933293640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd92c0a6130 con 0x7fd92c0a4930 2024-09-11T14:38:54.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93082e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd92c0a4930 0x7fd92c13b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93102f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd92c0a3e10 0x7fd92c0a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43426/0 (socket says 172.21.15.52:43426) 2024-09-11T14:38:54.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93082e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd92c0a4930 0x7fd92c13b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34448/0 (socket says 172.21.15.52:34448) 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93102f640 1 -- 172.21.15.52:0/2141181777 learned_addr learned my addr 172.21.15.52:0/2141181777 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93082e640 1 -- 172.21.15.52:0/2141181777 >> v1:172.21.15.52:6789/0 conn(0x7fd92c0a3e10 legacy=0x7fd92c0a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93082e640 1 -- 172.21.15.52:0/2141181777 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c0a5110 con 0x7fd92c0a4930 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd923fff640 1 -- 172.21.15.52:0/2141181777 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272715152 0 0) 0x7fd92c06ec50 con 0x7fd92c0a3e10 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd93082e640 1 --2- 172.21.15.52:0/2141181777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a4930 0x7fd92c13b2d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55129ffe1f429748 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd923fff640 1 -- 172.21.15.52:0/2141181777 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd91c009d90 con 0x7fd92c0a4930 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd923fff640 1 -- 172.21.15.52:0/2141181777 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd91c00e230 con 0x7fd92c0a4930 2024-09-11T14:38:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.269+0000 7fd923fff640 1 -- 172.21.15.52:0/2141181777 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd91c00e4d0 con 0x7fd92c0a4930 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 -- 172.21.15.52:0/2141181777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a4930 msgr2=0x7fd92c13b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 --2- 172.21.15.52:0/2141181777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a4930 0x7fd92c13b2d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 -- 172.21.15.52:0/2141181777 shutdown_connections 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 --2- 172.21.15.52:0/2141181777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a4930 0x7fd92c13b2d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 -- 172.21.15.52:0/2141181777 >> 172.21.15.52:0/2141181777 conn(0x7fd92c0a74f0 msgr2=0x7fd92c0a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 -- 172.21.15.52:0/2141181777 shutdown_connections 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 1 -- 172.21.15.52:0/2141181777 wait complete. 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.270+0000 7fd933293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.272+0000 7fd933293640 1 Processor -- start 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.272+0000 7fd933293640 1 -- start start 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd933293640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 0x7fd92c123f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd933293640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c126070 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd93102f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 0x7fd92c123f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd93102f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 0x7fd92c123f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34456/0 (socket says 172.21.15.52:34456) 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd93102f640 1 -- 172.21.15.52:0/2001810316 learned_addr learned my addr 172.21.15.52:0/2001810316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd93102f640 1 -- 172.21.15.52:0/2001810316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c1238e0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.274+0000 7fd93102f640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 0x7fd92c123f90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.275+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd928004b80 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.275+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd928004ce0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.275+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c123bf0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.275+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd928007120 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.275+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c126bb0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.276+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd9280072d0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.276+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c125ec0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.276+0000 7fd921ffb640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd91003e930 0x7fd910040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.276+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd92804f7f0 con 0x7fd92c0a3e10 2024-09-11T14:38:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.276+0000 7fd93082e640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd91003e930 0x7fd910040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.277+0000 7fd93082e640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd91003e930 0x7fd910040e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.281+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd92800f230 con 0x7fd92c0a3e10 2024-09-11T14:38:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.464+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd92c0a5e20 con 0x7fd91003e930 2024-09-11T14:38:54.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.466+0000 7fd921ffb640 1 -- 172.21.15.52:0/2001810316 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31202 (crc 0 0 0) 0x7fd91c00e3a0 con 0x7fd91003e930 2024-09-11T14:38:54.468 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:54.468 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.468+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd91003e930 msgr2=0x7fd910040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.468+0000 7fd933293640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd91003e930 0x7fd910040e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.468+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 msgr2=0x7fd92c123f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.468+0000 7fd933293640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 0x7fd92c123f90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.468+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 shutdown_connections 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.469+0000 7fd933293640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd91003e930 0x7fd910040e40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.469+0000 7fd933293640 1 --2- 172.21.15.52:0/2001810316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd92c0a3e10 0x7fd92c123f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.469+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 >> 172.21.15.52:0/2001810316 conn(0x7fd92c0a74f0 msgr2=0x7fd92c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.469+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 shutdown_connections 2024-09-11T14:38:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.469+0000 7fd933293640 1 -- 172.21.15.52:0/2001810316 wait complete. 2024-09-11T14:38:54.481 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-09-11T14:38:52.911741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187248,"statfs":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.263823"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.692965+0000","last_change":"2024-09-11T14:38:50.697395+0000","last_active":"2024-09-11T14:38:50.692965+0000","last_peered":"2024-09-11T14:38:50.692965+0000","last_clean":"2024-09-11T14:38:50.692965+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:38:50.692965+0000","last_undegraded":"2024-09-11T14:38:50.692965+0000","last_fullsized":"2024-09-11T14:38:50.692965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.693230+0000","last_change":"2024-09-11T14:38:50.696703+0000","last_active":"2024-09-11T14:38:50.693230+0000","last_peered":"2024-09-11T14:38:50.693230+0000","last_clean":"2024-09-11T14:38:50.693230+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:38:50.693230+0000","last_undegraded":"2024-09-11T14:38:50.693230+0000","last_fullsized":"2024-09-11T14:38:50.693230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.688715+0000","last_change":"2024-09-11T14:38:50.692528+0000","last_active":"2024-09-11T14:38:50.688715+0000","last_peered":"2024-09-11T14:38:50.688715+0000","last_clean":"2024-09-11T14:38:50.688715+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:38:50.688715+0000","last_undegraded":"2024-09-11T14:38:50.688715+0000","last_fullsized":"2024-09-11T14:38:50.688715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.686913+0000","last_change":"2024-09-11T14:38:50.691975+0000","last_active":"2024-09-11T14:38:50.686913+0000","last_peered":"2024-09-11T14:38:50.686913+0000","last_clean":"2024-09-11T14:38:50.686913+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:38:50.686913+0000","last_undegraded":"2024-09-11T14:38:50.686913+0000","last_fullsized":"2024-09-11T14:38:50.686913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.693043+0000","last_change":"2024-09-11T14:38:50.693043+0000","last_active":"2024-09-11T14:38:50.693043+0000","last_peered":"2024-09-11T14:38:50.693043+0000","last_clean":"2024-09-11T14:38:50.693043+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:38:50.693043+0000","last_undegraded":"2024-09-11T14:38:50.693043+0000","last_fullsized":"2024-09-11T14:38:50.693043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.686543+0000","last_change":"2024-09-11T14:38:50.691571+0000","last_active":"2024-09-11T14:38:50.686543+0000","last_peered":"2024-09-11T14:38:50.686543+0000","last_clean":"2024-09-11T14:38:50.686543+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:38:50.686543+0000","last_undegraded":"2024-09-11T14:38:50.686543+0000","last_fullsized":"2024-09-11T14:38:50.686543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.689115+0000","last_change":"2024-09-11T14:38:50.693770+0000","last_active":"2024-09-11T14:38:50.689115+0000","last_peered":"2024-09-11T14:38:50.689115+0000","last_clean":"2024-09-11T14:38:50.689115+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:38:50.689115+0000","last_undegraded":"2024-09-11T14:38:50.689115+0000","last_fullsized":"2024-09-11T14:38:50.689115+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.692561+0000","last_change":"2024-09-11T14:38:50.697078+0000","last_active":"2024-09-11T14:38:50.692561+0000","last_peered":"2024-09-11T14:38:50.692561+0000","last_clean":"2024-09-11T14:38:50.692561+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:38:50.692561+0000","last_undegraded":"2024-09-11T14:38:50.692561+0000","last_fullsized":"2024-09-11T14:38:50.692561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.686836+0000","last_change":"2024-09-11T14:38:46.649079+0000","last_active":"2024-09-11T14:38:50.686836+0000","last_peered":"2024-09-11T14:38:50.686836+0000","last_clean":"2024-09-11T14:38:50.686836+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:38:50.686836+0000","last_undegraded":"2024-09-11T14:38:50.686836+0000","last_fullsized":"2024-09-11T14:38:50.686836+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296556,"statfs":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297196,"statfs":{"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":528,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297200,"statfs":{"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1432,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296296,"statfs":{"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:54.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:38:54.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.590+0000 7f1947391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.596+0000 7f1947391640 1 Processor -- start 2024-09-11T14:38:54.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.596+0000 7f1947391640 1 -- start start 2024-09-11T14:38:54.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.597+0000 7f1947391640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19400a3e10 0x7f19400a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f1947391640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194006ec50 con 0x7f19400a4760 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f1947391640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f19400a6130 con 0x7f19400a3e10 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194512d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19400a3e10 0x7f19400a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194492c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f19400a4760 0x7f1940135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43434/0 (socket says 172.21.15.52:43434) 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194512d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19400a3e10 0x7f19400a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34464/0 (socket says 172.21.15.52:34464) 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194492c640 1 -- 172.21.15.52:0/453485605 learned_addr learned my addr 172.21.15.52:0/453485605 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194512d640 1 -- 172.21.15.52:0/453485605 >> v1:172.21.15.52:6789/0 conn(0x7f19400a4760 legacy=0x7f1940135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f1937fff640 1 -- 172.21.15.52:0/453485605 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776204042 0 0) 0x7f194006ec50 con 0x7f19400a4760 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194512d640 1 -- 172.21.15.52:0/453485605 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19400a5110 con 0x7f19400a3e10 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f194512d640 1 --2- 172.21.15.52:0/453485605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f19400a4220 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec7c9a1a1f09d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f1937fff640 1 -- 172.21.15.52:0/453485605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f193c009d90 con 0x7f19400a3e10 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f1937fff640 1 -- 172.21.15.52:0/453485605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f193c00e230 con 0x7f19400a3e10 2024-09-11T14:38:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.598+0000 7f1937fff640 1 -- 172.21.15.52:0/453485605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f193c00e4d0 con 0x7f19400a3e10 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 -- 172.21.15.52:0/453485605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 msgr2=0x7f19400a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 --2- 172.21.15.52:0/453485605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f19400a4220 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 -- 172.21.15.52:0/453485605 shutdown_connections 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 --2- 172.21.15.52:0/453485605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f19400a4220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 -- 172.21.15.52:0/453485605 >> 172.21.15.52:0/453485605 conn(0x7f19400a74f0 msgr2=0x7f19400a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 -- 172.21.15.52:0/453485605 shutdown_connections 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.599+0000 7f1947391640 1 -- 172.21.15.52:0/453485605 wait complete. 2024-09-11T14:38:54.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.600+0000 7f1947391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.602+0000 7f1947391640 1 Processor -- start 2024-09-11T14:38:54.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.602+0000 7f1947391640 1 -- start start 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.604+0000 7f1947391640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f1940123df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.604+0000 7f1947391640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1940126070 con 0x7f19400a3e10 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f194512d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f1940123df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f194512d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f1940123df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34472/0 (socket says 172.21.15.52:34472) 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f194512d640 1 -- 172.21.15.52:0/211226636 learned_addr learned my addr 172.21.15.52:0/211226636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f194512d640 1 -- 172.21.15.52:0/211226636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19401251c0 con 0x7f19400a3e10 2024-09-11T14:38:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f194512d640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f1940123df0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f193c013610 con 0x7f19400a3e10 2024-09-11T14:38:54.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f193c013770 con 0x7f19400a3e10 2024-09-11T14:38:54.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1940123780 con 0x7f19400a3e10 2024-09-11T14:38:54.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.605+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f193c013a10 con 0x7f19400a3e10 2024-09-11T14:38:54.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.606+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1940123a50 con 0x7f19400a3e10 2024-09-11T14:38:54.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.606+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f193c013c10 con 0x7f19400a3e10 2024-09-11T14:38:54.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.607+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1940125ae0 con 0x7f19400a3e10 2024-09-11T14:38:54.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.607+0000 7f1935ffb640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f192403e910 0x7f1924040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.607+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f193c018040 con 0x7f19400a3e10 2024-09-11T14:38:54.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.607+0000 7f194492c640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f192403e910 0x7f1924040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.608+0000 7f194492c640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f192403e910 0x7f1924040e20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.612+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f193c011380 con 0x7f19400a3e10 2024-09-11T14:38:54.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.794+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1940127850 con 0x7f192403e910 2024-09-11T14:38:54.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.795+0000 7f1935ffb640 1 -- 172.21.15.52:0/211226636 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31202 (crc 0 0 0) 0x7f1940127850 con 0x7f192403e910 2024-09-11T14:38:54.797 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:54.797 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f192403e910 msgr2=0x7f1924040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f192403e910 0x7f1924040e20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 msgr2=0x7f1940123df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f1940123df0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 shutdown_connections 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f192403e910 0x7f1924040e20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 --2- 172.21.15.52:0/211226636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19400a3e10 0x7f1940123df0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 >> 172.21.15.52:0/211226636 conn(0x7f19400a74f0 msgr2=0x7f19400713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 shutdown_connections 2024-09-11T14:38:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.797+0000 7f1947391640 1 -- 172.21.15.52:0/211226636 wait complete. 2024-09-11T14:38:54.809 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-09-11T14:38:52.911741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187248,"statfs":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.263823"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.692965+0000","last_change":"2024-09-11T14:38:50.697395+0000","last_active":"2024-09-11T14:38:50.692965+0000","last_peered":"2024-09-11T14:38:50.692965+0000","last_clean":"2024-09-11T14:38:50.692965+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:38:50.692965+0000","last_undegraded":"2024-09-11T14:38:50.692965+0000","last_fullsized":"2024-09-11T14:38:50.692965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.693230+0000","last_change":"2024-09-11T14:38:50.696703+0000","last_active":"2024-09-11T14:38:50.693230+0000","last_peered":"2024-09-11T14:38:50.693230+0000","last_clean":"2024-09-11T14:38:50.693230+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:38:50.693230+0000","last_undegraded":"2024-09-11T14:38:50.693230+0000","last_fullsized":"2024-09-11T14:38:50.693230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.688715+0000","last_change":"2024-09-11T14:38:50.692528+0000","last_active":"2024-09-11T14:38:50.688715+0000","last_peered":"2024-09-11T14:38:50.688715+0000","last_clean":"2024-09-11T14:38:50.688715+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:38:50.688715+0000","last_undegraded":"2024-09-11T14:38:50.688715+0000","last_fullsized":"2024-09-11T14:38:50.688715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.686913+0000","last_change":"2024-09-11T14:38:50.691975+0000","last_active":"2024-09-11T14:38:50.686913+0000","last_peered":"2024-09-11T14:38:50.686913+0000","last_clean":"2024-09-11T14:38:50.686913+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:38:50.686913+0000","last_undegraded":"2024-09-11T14:38:50.686913+0000","last_fullsized":"2024-09-11T14:38:50.686913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.693043+0000","last_change":"2024-09-11T14:38:50.693043+0000","last_active":"2024-09-11T14:38:50.693043+0000","last_peered":"2024-09-11T14:38:50.693043+0000","last_clean":"2024-09-11T14:38:50.693043+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:38:50.693043+0000","last_undegraded":"2024-09-11T14:38:50.693043+0000","last_fullsized":"2024-09-11T14:38:50.693043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.686543+0000","last_change":"2024-09-11T14:38:50.691571+0000","last_active":"2024-09-11T14:38:50.686543+0000","last_peered":"2024-09-11T14:38:50.686543+0000","last_clean":"2024-09-11T14:38:50.686543+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:38:50.686543+0000","last_undegraded":"2024-09-11T14:38:50.686543+0000","last_fullsized":"2024-09-11T14:38:50.686543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.689115+0000","last_change":"2024-09-11T14:38:50.693770+0000","last_active":"2024-09-11T14:38:50.689115+0000","last_peered":"2024-09-11T14:38:50.689115+0000","last_clean":"2024-09-11T14:38:50.689115+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:38:50.689115+0000","last_undegraded":"2024-09-11T14:38:50.689115+0000","last_fullsized":"2024-09-11T14:38:50.689115+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.692561+0000","last_change":"2024-09-11T14:38:50.697078+0000","last_active":"2024-09-11T14:38:50.692561+0000","last_peered":"2024-09-11T14:38:50.692561+0000","last_clean":"2024-09-11T14:38:50.692561+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:38:50.692561+0000","last_undegraded":"2024-09-11T14:38:50.692561+0000","last_fullsized":"2024-09-11T14:38:50.692561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:38:50.686836+0000","last_change":"2024-09-11T14:38:46.649079+0000","last_active":"2024-09-11T14:38:50.686836+0000","last_peered":"2024-09-11T14:38:50.686836+0000","last_clean":"2024-09-11T14:38:50.686836+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:38:50.686836+0000","last_undegraded":"2024-09-11T14:38:50.686836+0000","last_fullsized":"2024-09-11T14:38:50.686836+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296556,"statfs":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297196,"statfs":{"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":528,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297200,"statfs":{"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1432,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296296,"statfs":{"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:38:54.810 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:38:54.810 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T14:38:54.810 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T14:38:54.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T14:38:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.918+0000 7fce9c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.922+0000 7fce9c391640 1 Processor -- start 2024-09-11T14:38:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.922+0000 7fce9c391640 1 -- start start 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9c391640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce9409d0f0 0x7fce94138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9c391640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce94074a70 con 0x7fce9409e6c0 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9c391640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fce940a61f0 con 0x7fce9409d0f0 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9992c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce9409d0f0 0x7fce94138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9a12d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fce9409e6c0 0x7fce9409c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43444/0 (socket says 172.21.15.52:43444) 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9992c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce9409d0f0 0x7fce94138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34486/0 (socket says 172.21.15.52:34486) 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9a12d640 1 -- 172.21.15.52:0/2269043379 learned_addr learned my addr 172.21.15.52:0/2269043379 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9992c640 1 -- 172.21.15.52:0/2269043379 >> v1:172.21.15.52:6789/0 conn(0x7fce9409e6c0 legacy=0x7fce9409c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9992c640 1 -- 172.21.15.52:0/2269043379 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940a5ee0 con 0x7fce9409d0f0 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9992c640 1 --2- 172.21.15.52:0/2269043379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94138ee0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c44e889aeeb9d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.924+0000 7fce9912b640 1 -- 172.21.15.52:0/2269043379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce88009d80 con 0x7fce9409d0f0 2024-09-11T14:38:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9912b640 1 -- 172.21.15.52:0/2269043379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce8800e230 con 0x7fce9409d0f0 2024-09-11T14:38:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9912b640 1 -- 172.21.15.52:0/2269043379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce8800e4d0 con 0x7fce9409d0f0 2024-09-11T14:38:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 -- 172.21.15.52:0/2269043379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 msgr2=0x7fce94138ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 --2- 172.21.15.52:0/2269043379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94138ee0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 -- 172.21.15.52:0/2269043379 shutdown_connections 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 --2- 172.21.15.52:0/2269043379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94138ee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 -- 172.21.15.52:0/2269043379 >> 172.21.15.52:0/2269043379 conn(0x7fce940a43e0 msgr2=0x7fce94073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 -- 172.21.15.52:0/2269043379 shutdown_connections 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.925+0000 7fce9c391640 1 -- 172.21.15.52:0/2269043379 wait complete. 2024-09-11T14:38:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.926+0000 7fce9c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.927+0000 7fce9c391640 1 Processor -- start 2024-09-11T14:38:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.927+0000 7fce9c391640 1 -- start start 2024-09-11T14:38:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.929+0000 7fce9c391640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94123c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.929+0000 7fce9c391640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce94124630 con 0x7fce9409d0f0 2024-09-11T14:38:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.929+0000 7fce9a12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94123c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.929+0000 7fce9a12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94123c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34490/0 (socket says 172.21.15.52:34490) 2024-09-11T14:38:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.929+0000 7fce9a12d640 1 -- 172.21.15.52:0/423024052 learned_addr learned my addr 172.21.15.52:0/423024052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce9a12d640 1 -- 172.21.15.52:0/423024052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce94122550 con 0x7fce9409d0f0 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce9a12d640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94123c00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce900070b0 con 0x7fce9409d0f0 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce90007210 con 0x7fce9409d0f0 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce94124340 con 0x7fce9409d0f0 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce900074b0 con 0x7fce9409d0f0 2024-09-11T14:38:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.930+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce941249b0 con 0x7fce9409d0f0 2024-09-11T14:38:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.931+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fce900076a0 con 0x7fce9409d0f0 2024-09-11T14:38:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.931+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9409c9e0 con 0x7fce9409d0f0 2024-09-11T14:38:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.931+0000 7fce86ffd640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fce7803e930 0x7fce78040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.931+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fce90050030 con 0x7fce9409d0f0 2024-09-11T14:38:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.932+0000 7fce9992c640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fce7803e930 0x7fce78040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.932+0000 7fce9992c640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fce7803e930 0x7fce78040e40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:54.937+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fce90009850 con 0x7fce9409d0f0 2024-09-11T14:38:55.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.158+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fce941232e0 con 0x7fce9409d0f0 2024-09-11T14:38:55.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.158+0000 7fce86ffd640 1 -- 172.21.15.52:0/423024052 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7fce90009430 con 0x7fce9409d0f0 2024-09-11T14:38:55.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:38:55.160 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T14:38:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.160+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fce7803e930 msgr2=0x7fce78040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.160+0000 7fce9c391640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fce7803e930 0x7fce78040e40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.160+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 msgr2=0x7fce94123c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.160+0000 7fce9c391640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94123c00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.161+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 shutdown_connections 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.161+0000 7fce9c391640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fce7803e930 0x7fce78040e40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.161+0000 7fce9c391640 1 --2- 172.21.15.52:0/423024052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9409d0f0 0x7fce94123c00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.161+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 >> 172.21.15.52:0/423024052 conn(0x7fce940a43e0 msgr2=0x7fce941bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.161+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 shutdown_connections 2024-09-11T14:38:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:38:55.161+0000 7fce9c391640 1 -- 172.21.15.52:0/423024052 wait complete. 2024-09-11T14:38:55.173 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T14:38:55.173 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T14:38:55.187 INFO:tasks.workunit:Pulling workunits from ref dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 2024-09-11T14:38:55.187 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T14:38:55.188 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:38:55.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:38:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-11T14:38:55.204 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:38:55.259 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-11T14:38:55.260 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-11T14:38:55.316 INFO:tasks.workunit:timeout=3h 2024-09-11T14:38:55.316 INFO:tasks.workunit:cleanup=True 2024-09-11T14:38:55.316 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/matan-b/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 2024-09-11T14:38:55.372 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to 'dbebf1a3db6db7b5579464ee715edcf1b3e9cce2'. 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T14:39:39.747 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-11T14:39:39.748 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at dbebf1a3db6 qa/config/seastore: enable all subsystem debug 2024-09-11T14:39:39.751 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T14:39:39.818 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T14:39:39.820 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:39:39.820 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T14:39:40.567 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T14:39:40.649 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T14:39:40.692 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:39:40.694 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:39:40.694 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T14:39:40.734 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:39:40.738 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-11T14:39:40.738 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T14:39:40.794 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-11T14:39:40.795 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-11T14:39:40.796 DEBUG:teuthology.orchestra.run.smithi052:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-11T14:39:40.856 INFO:tasks.workunit.client.0.smithi052.stderr:+ parallel=1 2024-09-11T14:39:40.856 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' --crimson = --serial ']' 2024-09-11T14:39:40.856 INFO:tasks.workunit.client.0.smithi052.stderr:+ crimson=0 2024-09-11T14:39:40.856 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' --crimson = --crimson ']' 2024-09-11T14:39:40.856 INFO:tasks.workunit.client.0.smithi052.stderr:+ parallel=0 2024-09-11T14:39:40.856 INFO:tasks.workunit.client.0.smithi052.stderr:+ crimson=1 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ color= 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -t 1 ']' 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ declare -A pids 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:39:40.857 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_aio 2024-09-11T14:39:40.873 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:39:40.874 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-11T14:39:40.874 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:39:40.874 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 26 tests from LibRadosAio 2024-09-11T14:39:40.874 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-11T14:39:43.472 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.TooBig (2599 ms) 2024-09-11T14:39:43.472 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-11T14:39:46.485 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.SimpleWrite (3013 ms) 2024-09-11T14:39:46.485 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-11T14:39:49.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.WaitForSafe (3012 ms) 2024-09-11T14:39:49.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-11T14:39:52.509 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTrip (3011 ms) 2024-09-11T14:39:52.509 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-11T14:39:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTrip2 (3013 ms) 2024-09-11T14:39:55.522 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-11T14:39:58.533 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTrip3 (3011 ms) 2024-09-11T14:39:58.533 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-11T14:40:01.546 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripAppend (3013 ms) 2024-09-11T14:40:01.546 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-11T14:40:04.556 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RemoveTest (3010 ms) 2024-09-11T14:40:04.556 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-11T14:40:07.573 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3018 ms) 2024-09-11T14:40:07.574 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-11T14:40:10.584 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RmXattr (3011 ms) 2024-09-11T14:40:10.584 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-11T14:40:13.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.XattrIter (3014 ms) 2024-09-11T14:40:13.599 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-11T14:40:16.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.IsComplete (3009 ms) 2024-09-11T14:40:16.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-11T14:40:19.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.IsSafe (3017 ms) 2024-09-11T14:40:19.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-11T14:40:22.637 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.ReturnValue (3013 ms) 2024-09-11T14:40:22.637 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.Flush 2024-09-11T14:40:25.652 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.Flush (3015 ms) 2024-09-11T14:40:25.652 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-11T14:40:28.660 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.FlushAsync (3008 ms) 2024-09-11T14:40:28.661 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-11T14:40:31.676 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3015 ms) 2024-09-11T14:40:31.676 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-11T14:40:34.689 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3013 ms) 2024-09-11T14:40:34.689 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-11T14:40:37.465 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.SimpleStat (2776 ms) 2024-09-11T14:40:37.465 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-11T14:40:40.478 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.OperateMtime (3012 ms) 2024-09-11T14:40:40.478 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-11T14:40:43.485 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.Operate2Mtime (3007 ms) 2024-09-11T14:40:43.485 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-11T14:40:46.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.SimpleStatNS (3013 ms) 2024-09-11T14:40:46.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-11T14:40:49.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.StatRemove (3013 ms) 2024-09-11T14:40:49.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-11T14:40:52.528 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.ExecuteClass (3017 ms) 2024-09-11T14:40:52.528 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-11T14:40:55.541 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.MultiWrite (3013 ms) 2024-09-11T14:40:55.541 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-11T14:40:58.553 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.AioUnlock (3011 ms) 2024-09-11T14:40:58.553 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 26 tests from LibRadosAio (77678 ms total) 2024-09-11T14:40:58.553 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:40:58.553 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1100: Skipped 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1132: Skipped 2024-09-11T14:40:58.554 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1149: Skipped 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1182: Skipped 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1215: Skipped 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1286: Skipped 2024-09-11T14:40:58.556 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1326: Skipped 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-11T14:40:58.557 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1366: Skipped 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1385: Skipped 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1415: Skipped 2024-09-11T14:40:58.558 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1454: Skipped 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-11T14:40:58.559 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1498: Skipped 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1532: Skipped 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1593: Skipped 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.560 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1649: Skipped 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio.cc:1681: Skipped 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 42 tests from 2 test suites ran. (77678 ms total) 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 26 tests. 2024-09-11T14:40:58.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T14:40:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-11T14:40:58.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-11T14:40:58.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-11T14:40:58.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-11T14:40:58.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-11T14:40:58.563 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:40:58.564 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:40:58.564 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_aio_pp 2024-09-11T14:40:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:40:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-11T14:40:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:40:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 32 tests from LibRadosAio 2024-09-11T14:40:58.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-11T14:41:01.465 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.TooBigPP (2886 ms) 2024-09-11T14:41:01.465 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-11T14:41:18.501 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.PoolQuotaPP (17037 ms) 2024-09-11T14:41:18.502 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-11T14:41:24.526 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.SimpleWritePP (6024 ms) 2024-09-11T14:41:24.526 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-11T14:41:27.535 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.WaitForSafePP (3009 ms) 2024-09-11T14:41:27.535 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-11T14:41:30.548 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripPP (3013 ms) 2024-09-11T14:41:30.548 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-11T14:41:33.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3015 ms) 2024-09-11T14:41:33.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-11T14:41:36.472 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2910 ms) 2024-09-11T14:41:36.472 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-11T14:41:39.488 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3015 ms) 2024-09-11T14:41:39.488 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-11T14:41:42.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.IsCompletePP (3010 ms) 2024-09-11T14:41:42.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-11T14:41:45.515 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.IsSafePP (3017 ms) 2024-09-11T14:41:45.515 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-11T14:41:48.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.ReturnValuePP (3001 ms) 2024-09-11T14:41:48.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-11T14:41:51.529 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.FlushPP (3014 ms) 2024-09-11T14:41:51.529 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-11T14:41:54.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3012 ms) 2024-09-11T14:41:54.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-11T14:41:57.550 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3008 ms) 2024-09-11T14:41:57.550 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-11T14:42:00.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3011 ms) 2024-09-11T14:42:00.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-11T14:42:03.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3018 ms) 2024-09-11T14:42:03.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-11T14:42:06.479 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2901 ms) 2024-09-11T14:42:06.479 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-11T14:42:09.490 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3010 ms) 2024-09-11T14:42:09.490 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-11T14:42:12.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.SimpleStatPP (3008 ms) 2024-09-11T14:42:12.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-11T14:42:15.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.OperateMtime (3015 ms) 2024-09-11T14:42:15.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-11T14:42:18.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.OperateMtime2 (3003 ms) 2024-09-11T14:42:18.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-11T14:42:21.529 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.StatRemovePP (3014 ms) 2024-09-11T14:42:21.529 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-11T14:42:24.541 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3012 ms) 2024-09-11T14:42:24.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-11T14:42:27.550 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.OmapPP (3008 ms) 2024-09-11T14:42:27.550 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-11T14:42:30.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.MultiWritePP (3015 ms) 2024-09-11T14:42:30.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-11T14:42:33.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.AioUnlockPP (3013 ms) 2024-09-11T14:42:33.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-11T14:42:36.489 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2911 ms) 2024-09-11T14:42:36.489 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-11T14:42:39.500 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RacingRemovePP (3012 ms) 2024-09-11T14:42:39.500 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-11T14:42:42.511 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3010 ms) 2024-09-11T14:42:42.512 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-11T14:42:45.526 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3016 ms) 2024-09-11T14:42:45.526 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-11T14:42:47.987 INFO:tasks.workunit.client.0.smithi052.stdout:setting pool EIO 2024-09-11T14:42:57.648 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 802 2024-09-11T14:42:58.648 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 761 2024-09-11T14:42:59.648 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 720 2024-09-11T14:43:00.648 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 680 2024-09-11T14:43:01.649 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 640 2024-09-11T14:43:02.649 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 598 2024-09-11T14:43:03.649 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 557 2024-09-11T14:43:04.649 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for 515 2024-09-11T14:43:05.649 INFO:tasks.workunit.client.0.smithi052.stdout:max_success 523, min_failed 524 2024-09-11T14:43:06.497 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAio.PoolEIOFlag (20970 ms) 2024-09-11T14:43:06.497 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-11T14:43:06.497 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-11T14:43:06.497 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:06.497 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-11T14:43:06.498 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 32 tests from LibRadosAio (127918 ms total) 2024-09-11T14:43:06.498 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:43:06.498 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-11T14:43:06.498 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-11T14:43:20.521 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (14024 ms) 2024-09-11T14:43:20.522 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-11T14:43:29.506 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8985 ms) 2024-09-11T14:43:29.506 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-11T14:43:44.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15058 ms) 2024-09-11T14:43:44.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-11T14:43:47.573 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3009 ms) 2024-09-11T14:43:47.573 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosAioPP (41076 ms total) 2024-09-11T14:43:47.573 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:43:47.573 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosIoPP 2024-09-11T14:43:47.573 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T14:43:50.589 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.XattrListPP (3012 ms) 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosIoPP (3012 ms total) 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-11T14:43:50.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-11T14:43:50.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-11T14:43:50.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.593 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-11T14:43:50.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:43:50.596 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 57 tests from 4 test suites ran. (172006 ms total) 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 36 tests. 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-11T14:43:50.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-11T14:43:50.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-11T14:43:50.599 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:43:50.599 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:43:50.599 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_io 2024-09-11T14:43:50.609 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:43:50.609 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-11T14:43:50.609 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:43:50.609 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from LibRadosIo 2024-09-11T14:43:52.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-11T14:43:52.991 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.SimpleWrite (400 ms) 2024-09-11T14:43:52.991 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-11T14:43:52.991 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-11T14:43:52.991 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:no timeout :/ 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:no timeout :/ 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:no timeout :/ 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:no timeout :/ 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:no timeout :/ 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.ReadTimeout (168 ms) 2024-09-11T14:43:53.159 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-11T14:43:53.217 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.RoundTrip (59 ms) 2024-09-11T14:43:53.217 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-11T14:43:53.246 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.Checksum (29 ms) 2024-09-11T14:43:53.246 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-11T14:43:53.298 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (51 ms) 2024-09-11T14:43:53.298 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-11T14:43:53.349 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (52 ms) 2024-09-11T14:43:53.350 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-11T14:43:53.406 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.AppendRoundTrip (57 ms) 2024-09-11T14:43:53.406 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-11T14:43:53.412 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.ZeroLenZero (6 ms) 2024-09-11T14:43:53.413 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-11T14:43:53.468 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.TruncTest (55 ms) 2024-09-11T14:43:53.468 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-11T14:43:53.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.RemoveTest (48 ms) 2024-09-11T14:43:53.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-11T14:43:53.566 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (50 ms) 2024-09-11T14:43:53.566 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-11T14:43:53.722 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.RmXattr (156 ms) 2024-09-11T14:43:53.722 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-11T14:43:53.789 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIo.XattrIter (68 ms) 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from LibRadosIo (1199 ms total) 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-11T14:43:54.601 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T14:43:54.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-11T14:43:54.603 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-11T14:43:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-11T14:43:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:43:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 24 tests from 2 test suites ran. (3991 ms total) 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 14 tests. 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T14:43:54.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-11T14:43:54.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-11T14:43:54.608 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:43:54.608 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:43:54.608 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_io_pp 2024-09-11T14:43:54.626 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:43:54.626 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-11T14:43:54.627 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:43:54.627 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-11T14:43:54.627 INFO:tasks.workunit.client.0.smithi052.stdout:seed 30912 2024-09-11T14:43:56.505 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-11T14:43:56.505 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-11T14:43:56.505 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-11T14:43:56.975 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (470 ms) 2024-09-11T14:43:56.976 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-11T14:43:57.085 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.ReadOpPP (110 ms) 2024-09-11T14:43:57.085 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-11T14:43:57.126 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (40 ms) 2024-09-11T14:43:57.126 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-11T14:44:01.717 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (4592 ms) 2024-09-11T14:44:01.717 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-11T14:44:01.750 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.RoundTripPP (32 ms) 2024-09-11T14:44:01.750 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-11T14:44:01.780 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (31 ms) 2024-09-11T14:44:01.781 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-11T14:44:01.811 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.Checksum (31 ms) 2024-09-11T14:44:01.812 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-11T14:44:01.846 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (34 ms) 2024-09-11T14:44:01.846 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-11T14:44:01.895 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (49 ms) 2024-09-11T14:44:01.895 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-11T14:44:01.946 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (52 ms) 2024-09-11T14:44:01.947 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-11T14:44:01.980 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (33 ms) 2024-09-11T14:44:01.980 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-11T14:44:02.029 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (49 ms) 2024-09-11T14:44:02.029 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-11T14:44:02.078 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.TruncTestPP (50 ms) 2024-09-11T14:44:02.079 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-11T14:44:02.122 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (44 ms) 2024-09-11T14:44:02.123 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-11T14:44:02.173 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (51 ms) 2024-09-11T14:44:02.174 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-11T14:44:02.314 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.RmXattrPP (141 ms) 2024-09-11T14:44:02.314 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T14:44:02.378 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.XattrListPP (64 ms) 2024-09-11T14:44:02.378 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-11T14:44:02.425 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (46 ms) 2024-09-11T14:44:02.425 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-11T14:44:02.475 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.CmpExtPP (51 ms) 2024-09-11T14:44:02.475 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-11T14:44:02.505 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (29 ms) 2024-09-11T14:44:02.505 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-11T14:44:02.547 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (42 ms) 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 22 tests from LibRadosIoPP (6041 ms total) 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.509 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-11T14:44:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.511 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-11T14:44:03.513 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-11T14:44:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.515 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:44:03.517 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 40 tests from 2 test suites ran. (8882 ms total) 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 22 tests. 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T14:44:03.518 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-11T14:44:03.519 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-11T14:44:03.519 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-11T14:44:03.519 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-11T14:44:03.519 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T14:44:03.519 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T14:44:03.519 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:44:03.520 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:44:03.520 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_asio 2024-09-11T14:44:03.550 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.547+0000 7fadf182d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:03.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.554+0000 7fadf182d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:03.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.555+0000 7fadf182d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:03.557 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-11T14:44:03.557 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:44:03.557 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 12 tests from AsioRados 2024-09-11T14:44:03.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.556+0000 7fadf182d6c0 1 Processor -- start 2024-09-11T14:44:03.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.556+0000 7fadf182d6c0 1 -- start start 2024-09-11T14:44:03.560 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.557+0000 7fadf182d6c0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 0x22381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:44:03.560 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.557+0000 7fadf182d6c0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x211e520 con 0x224e750 2024-09-11T14:44:03.560 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.557+0000 7fade9c3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 0x22381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:44:03.560 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.557+0000 7fade9c3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 0x22381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54532/0 (socket says 172.21.15.52:54532) 2024-09-11T14:44:03.560 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.557+0000 7fade9c3f640 1 -- 172.21.15.52:0/2719681176 learned_addr learned my addr 172.21.15.52:0/2719681176 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:44:03.560 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.558+0000 7fade9c3f640 1 -- 172.21.15.52:0/2719681176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20bae10 con 0x224e750 2024-09-11T14:44:03.561 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.558+0000 7fade9c3f640 1 --2- 172.21.15.52:0/2719681176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 0x22381a0 crc :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac99c8d29656f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:44:03.561 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.558+0000 7fade37fe640 1 -- 172.21.15.52:0/2719681176 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd400b580 con 0x224e750 2024-09-11T14:44:03.561 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.558+0000 7fade37fe640 1 -- 172.21.15.52:0/2719681176 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fadd400b6e0 con 0x224e750 2024-09-11T14:44:03.561 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.558+0000 7fade37fe640 1 -- 172.21.15.52:0/2719681176 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd400b980 con 0x224e750 2024-09-11T14:44:03.562 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 -- 172.21.15.52:0/2719681176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 msgr2=0x22381a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:44:03.562 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/2719681176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 0x22381a0 crc :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:03.562 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 -- 172.21.15.52:0/2719681176 shutdown_connections 2024-09-11T14:44:03.562 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/2719681176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x224e750 0x22381a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:03.562 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 -- 172.21.15.52:0/2719681176 >> 172.21.15.52:0/2719681176 conn(0x20de770 msgr2=0x21bb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:44:03.563 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 -- 172.21.15.52:0/2719681176 shutdown_connections 2024-09-11T14:44:03.563 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.560+0000 7fadf182d6c0 1 -- 172.21.15.52:0/2719681176 wait complete. 2024-09-11T14:44:03.564 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.562+0000 7fadf182d6c0 1 Processor -- start 2024-09-11T14:44:03.564 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.562+0000 7fadf182d6c0 1 -- start start 2024-09-11T14:44:03.566 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.564+0000 7fadf182d6c0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 0x223bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:44:03.566 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.564+0000 7fadf182d6c0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x211c280 con 0x22515a0 2024-09-11T14:44:03.567 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.564+0000 7fade9c3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 0x223bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:44:03.567 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.564+0000 7fade9c3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 0x223bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54534/0 (socket says 172.21.15.52:54534) 2024-09-11T14:44:03.567 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.564+0000 7fade9c3f640 1 -- 172.21.15.52:0/1461947511 learned_addr learned my addr 172.21.15.52:0/1461947511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.565+0000 7fade9c3f640 1 -- 172.21.15.52:0/1461947511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20ac920 con 0x22515a0 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.565+0000 7fade9c3f640 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 0x223bbe0 crc :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.565+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd4012840 con 0x22515a0 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.565+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fadd4005040 con 0x22515a0 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.565+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd4012ad0 con 0x22515a0 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.566+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20ac380 con 0x22515a0 2024-09-11T14:44:03.568 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.566+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x223d3a0 con 0x22515a0 2024-09-11T14:44:03.569 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.567+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fadd400d040 con 0x22515a0 2024-09-11T14:44:03.569 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.567+0000 7fade27fc640 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fadd003d1c0 0x7fadd003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:44:03.569 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.567+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(239..239 src has 1..239) ==== 2700+0+0 (crc 0 0 0) 0x7fadd400a040 con 0x22515a0 2024-09-11T14:44:03.570 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.567+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x2114df0 con 0x22515a0 2024-09-11T14:44:03.570 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.568+0000 7fade943e640 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fadd003d1c0 0x7fadd003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:44:03.570 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.568+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=239) ==== 24+0+0 (crc 0 0 0) 0x7fadd4007460 con 0x22515a0 2024-09-11T14:44:03.570 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.568+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x2127bf0 con 0x22515a0 2024-09-11T14:44:03.571 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:03.568+0000 7fade943e640 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fadd003d1c0 0x7fadd003f6d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:44:04.508 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.505+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v240) ==== 43+0+0 (crc 0 0 0) 0x7fadd4007230 con 0x22515a0 2024-09-11T14:44:04.508 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.505+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=240}) -- 0x7fadd0041b40 con 0x22515a0 2024-09-11T14:44:04.508 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.506+0000 7fade27fc640 1 -- 172.21.15.52:0/1461947511 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(240..240 src has 1..240) ==== 651+0+0 (crc 0 0 0) 0x7fadd400d2f0 con 0x22515a0 2024-09-11T14:44:04.508 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.506+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> v2:172.21.15.52:6802/4284075780 conn(0x22e7be0 0x22ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:44:04.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.506+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x223ec50 con 0x22e7be0 2024-09-11T14:44:04.513 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.511+0000 7fadea440640 1 --2- 172.21.15.52:0/1461947511 >> v2:172.21.15.52:6802/4284075780 conn(0x22e7be0 0x22ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:44:04.540 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:04.538+0000 7fadea440640 1 --2- 172.21.15.52:0/1461947511 >> v2:172.21.15.52:6802/4284075780 conn(0x22e7be0 0x22ea000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:44:05.782 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.780+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== osd_op_reply(2 exist [writefull 0~5] v241'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.783 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-11T14:44:05.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.780+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22e47a0 con 0x22e7be0 2024-09-11T14:44:05.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.780+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22e5040 con 0x22e7be0 2024-09-11T14:44:05.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.819+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v241'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.819+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.821 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncReadCallback (38 ms) 2024-09-11T14:44:05.821 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-11T14:44:05.822 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.819+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22e5420 con 0x22e7be0 2024-09-11T14:44:05.822 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.819+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22ea540 con 0x22e7be0 2024-09-11T14:44:05.839 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.837+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v241'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.839 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.837+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.840 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncReadFuture (19 ms) 2024-09-11T14:44:05.840 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-11T14:44:05.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.837+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22e4b70 con 0x22e7be0 2024-09-11T14:44:05.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.837+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x232ad70 con 0x22e7be0 2024-09-11T14:44:05.860 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.856+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v241'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.860 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.857+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 7 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.860 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncReadYield (19 ms) 2024-09-11T14:44:05.861 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-11T14:44:05.861 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.857+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x223c270 con 0x22e7be0 2024-09-11T14:44:05.883 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.881+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 8 ==== osd_op_reply(9 exist [write 0~5] v241'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.883 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncWriteCallback (24 ms) 2024-09-11T14:44:05.883 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-11T14:44:05.884 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.881+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x223c270 con 0x22e7be0 2024-09-11T14:44:05.906 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.905+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 9 ==== osd_op_reply(10 exist [write 0~5] v241'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.907 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncWriteFuture (24 ms) 2024-09-11T14:44:05.907 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-11T14:44:05.907 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.905+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x230db70 con 0x22e7be0 2024-09-11T14:44:05.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.927+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 10 ==== osd_op_reply(11 exist [write 0~5] v241'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.930 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncWriteYield (23 ms) 2024-09-11T14:44:05.930 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-11T14:44:05.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.927+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22ead50 con 0x22e7be0 2024-09-11T14:44:05.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.927+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22eb6b0 con 0x22e7be0 2024-09-11T14:44:05.942 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.940+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.942 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.940+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v241'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.942 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (13 ms) 2024-09-11T14:44:05.943 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-11T14:44:05.943 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.940+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22ead50 con 0x22e7be0 2024-09-11T14:44:05.943 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.940+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x230e140 con 0x22e7be0 2024-09-11T14:44:05.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.953+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.953+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v241'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.955 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (12 ms) 2024-09-11T14:44:05.955 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-11T14:44:05.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.953+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x230db70 con 0x22e7be0 2024-09-11T14:44:05.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.953+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0x22ead50 con 0x22e7be0 2024-09-11T14:44:05.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.964+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.967 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.964+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v241'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.967 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncReadOperationYield (11 ms) 2024-09-11T14:44:05.967 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-11T14:44:05.967 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.964+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x22ea8a0 con 0x22e7be0 2024-09-11T14:44:05.989 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.988+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 17 ==== osd_op_reply(18 exist [writefull 0~5] v241'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:05.990 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (23 ms) 2024-09-11T14:44:05.990 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-11T14:44:05.990 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:05.988+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x22ea8a0 con 0x22e7be0 2024-09-11T14:44:06.014 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.012+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 18 ==== osd_op_reply(19 exist [writefull 0~5] v241'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:06.014 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (25 ms) 2024-09-11T14:44:06.014 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-11T14:44:06.014 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.012+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0x22ea8a0 con 0x22e7be0 2024-09-11T14:44:06.037 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.034+0000 7fadea440640 1 -- 172.21.15.52:0/1461947511 <== osd.1 v2:172.21.15.52:6802/4284075780 19 ==== osd_op_reply(20 exist [writefull 0~5] v241'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7faddc00a430 con 0x22e7be0 2024-09-11T14:44:06.037 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (22 ms) 2024-09-11T14:44:06.038 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 >> v2:172.21.15.52:6802/4284075780 conn(0x22e7be0 msgr2=0x22ea000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:44:06.038 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> v2:172.21.15.52:6802/4284075780 conn(0x22e7be0 0x22ea000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:06.038 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fadd003d1c0 msgr2=0x7fadd003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:44:06.038 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fadd003d1c0 0x7fadd003f6d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:06.038 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 msgr2=0x223bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:44:06.038 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 0x223bbe0 crc :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 shutdown_connections 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> v2:172.21.15.52:6802/4284075780 conn(0x22e7be0 0x22ea000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fadd003d1c0 0x7fadd003f6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 --2- 172.21.15.52:0/1461947511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x22515a0 0x223bbe0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 >> 172.21.15.52:0/1461947511 conn(0x20de770 msgr2=0x21b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 shutdown_connections 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.035+0000 7fadf182d6c0 1 -- 172.21.15.52:0/1461947511 wait complete. 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 12 tests from AsioRados (254 ms total) 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:06.039 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:44:06.040 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 12 tests from 1 test suite ran. (2481 ms total) 2024-09-11T14:44:06.040 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 12 tests. 2024-09-11T14:44:06.040 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:44:06.040 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:44:06.040 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_list 2024-09-11T14:44:06.071 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.069+0000 7f6d96ce59c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:06.071 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.069+0000 7f6d96ce59c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:06.071 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:06.069+0000 7f6d96ce59c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:06.071 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-11T14:44:06.071 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:44:06.072 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from LibRadosList 2024-09-11T14:44:07.504 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-11T14:44:08.291 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.ListObjects (786 ms) 2024-09-11T14:44:08.291 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-11T14:44:08.667 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (377 ms) 2024-09-11T14:44:08.667 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-11T14:44:08.855 INFO:tasks.workunit.client.0.smithi052.stdout:myset foo1,foo2,foo3 2024-09-11T14:44:09.007 INFO:tasks.workunit.client.0.smithi052.stdout:foo1 2024-09-11T14:44:09.007 INFO:tasks.workunit.client.0.smithi052.stdout:foo2 2024-09-11T14:44:09.007 INFO:tasks.workunit.client.0.smithi052.stdout:foo3 2024-09-11T14:44:09.007 INFO:tasks.workunit.client.0.smithi052.stdout:myset foo1,foo4,foo5 2024-09-11T14:44:09.158 INFO:tasks.workunit.client.0.smithi052.stdout:foo4 2024-09-11T14:44:09.158 INFO:tasks.workunit.client.0.smithi052.stdout:foo5 2024-09-11T14:44:09.158 INFO:tasks.workunit.client.0.smithi052.stdout:foo1 2024-09-11T14:44:09.158 INFO:tasks.workunit.client.0.smithi052.stdout:myset foo6,foo7 2024-09-11T14:44:09.309 INFO:tasks.workunit.client.0.smithi052.stdout:foo7 2024-09-11T14:44:09.310 INFO:tasks.workunit.client.0.smithi052.stdout:foo6 2024-09-11T14:44:09.310 INFO:tasks.workunit.client.0.smithi052.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout:ns1:foo4 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout:ns1:foo5 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout:ns2:foo7 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout:ns2:foo6 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout:ns1:foo1 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout::foo1 2024-09-11T14:44:09.460 INFO:tasks.workunit.client.0.smithi052.stdout::foo2 2024-09-11T14:44:09.461 INFO:tasks.workunit.client.0.smithi052.stdout::foo3 2024-09-11T14:44:09.760 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.ListObjectsNS (1092 ms) 2024-09-11T14:44:09.760 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-11T14:44:10.292 INFO:tasks.workunit.client.0.smithi052.stdout:1 0 2024-09-11T14:44:10.292 INFO:tasks.workunit.client.0.smithi052.stdout:10 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:13 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:7 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:14 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:0 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:15 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:11 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:5 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:8 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:6 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:3 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:4 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:12 0 2024-09-11T14:44:10.293 INFO:tasks.workunit.client.0.smithi052.stdout:9 0 2024-09-11T14:44:10.294 INFO:tasks.workunit.client.0.smithi052.stdout:2 0 2024-09-11T14:44:10.443 INFO:tasks.workunit.client.0.smithi052.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-11T14:44:10.880 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.ListObjectsStart (1120 ms) 2024-09-11T14:44:10.880 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-11T14:44:11.217 INFO:tasks.workunit.client.0.smithi052.stdout:x cursor=MIN 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-11T14:44:11.370 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-11T14:44:11.371 INFO:tasks.workunit.client.0.smithi052.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-11T14:44:11.523 INFO:tasks.workunit.client.0.smithi052.stdout:FIRST> seek to MIN oid=1 2024-09-11T14:44:11.677 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-11T14:44:11.677 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:02547ec2:::1:head 2024-09-11T14:44:11.829 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:02547ec2:::1:head -> 1 2024-09-11T14:44:11.830 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-11T14:44:11.830 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:52ea6a34:::10:head 2024-09-11T14:44:11.935 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-11T14:44:11.936 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-11T14:44:11.936 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:566253c9:::13:head 2024-09-11T14:44:12.040 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:566253c9:::13:head -> 13 2024-09-11T14:44:12.040 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-11T14:44:12.040 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-11T14:44:12.147 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-11T14:44:12.148 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-11T14:44:12.148 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:62a1935d:::14:head 2024-09-11T14:44:12.243 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:62a1935d:::14:head -> 14 2024-09-11T14:44:12.243 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-11T14:44:12.243 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:6cac518f:::0:head 2024-09-11T14:44:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:6cac518f:::0:head -> 0 2024-09-11T14:44:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-11T14:44:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:863748b0:::15:head 2024-09-11T14:44:12.406 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:863748b0:::15:head -> 15 2024-09-11T14:44:12.406 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-11T14:44:12.406 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:89d3ae78:::11:head 2024-09-11T14:44:12.477 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-11T14:44:12.477 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-11T14:44:12.477 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:b29083e3:::5:head 2024-09-11T14:44:12.524 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:b29083e3:::5:head -> 5 2024-09-11T14:44:12.524 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-11T14:44:12.524 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-11T14:44:12.566 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-11T14:44:12.566 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-11T14:44:12.566 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-11T14:44:12.604 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-11T14:44:12.604 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-11T14:44:12.604 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:cfc208b3:::3:head 2024-09-11T14:44:12.636 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-11T14:44:12.636 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-11T14:44:12.636 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:d83876eb:::4:head 2024-09-11T14:44:12.659 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:d83876eb:::4:head -> 4 2024-09-11T14:44:12.659 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-11T14:44:12.659 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-11T14:44:12.681 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-11T14:44:12.681 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-11T14:44:12.681 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:e960b815:::9:head 2024-09-11T14:44:12.694 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:e960b815:::9:head -> 9 2024-09-11T14:44:12.694 INFO:tasks.workunit.client.0.smithi052.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-11T14:44:12.694 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:f905c69b:::2:head 2024-09-11T14:44:12.698 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:f905c69b:::2:head -> 2 2024-09-11T14:44:12.698 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:52ea6a34:::10:head 2024-09-11T14:44:12.699 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-11T14:44:12.803 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-11T14:44:12.803 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=10 expected=10 2024-09-11T14:44:12.803 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-11T14:44:12.804 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-11T14:44:12.828 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-11T14:44:12.828 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=12 expected=12 2024-09-11T14:44:12.828 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:d83876eb:::4:head 2024-09-11T14:44:12.828 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-11T14:44:12.850 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:d83876eb:::4:head -> 4 2024-09-11T14:44:12.850 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=4 expected=4 2024-09-11T14:44:12.850 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:b29083e3:::5:head 2024-09-11T14:44:12.851 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-11T14:44:12.897 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:b29083e3:::5:head -> 5 2024-09-11T14:44:12.898 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=5 expected=5 2024-09-11T14:44:12.898 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:f905c69b:::2:head 2024-09-11T14:44:12.898 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-11T14:44:12.902 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:f905c69b:::2:head -> 2 2024-09-11T14:44:12.902 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=2 expected=2 2024-09-11T14:44:12.902 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:e960b815:::9:head 2024-09-11T14:44:12.902 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-11T14:44:12.914 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:e960b815:::9:head -> 9 2024-09-11T14:44:12.914 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=9 expected=9 2024-09-11T14:44:12.914 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:89d3ae78:::11:head 2024-09-11T14:44:12.914 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-11T14:44:12.985 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-11T14:44:12.986 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=11 expected=11 2024-09-11T14:44:12.986 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:863748b0:::15:head 2024-09-11T14:44:12.986 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-11T14:44:13.061 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:863748b0:::15:head -> 15 2024-09-11T14:44:13.061 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=15 expected=15 2024-09-11T14:44:13.061 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:6cac518f:::0:head 2024-09-11T14:44:13.061 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-11T14:44:13.150 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:6cac518f:::0:head -> 0 2024-09-11T14:44:13.151 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=0 expected=0 2024-09-11T14:44:13.151 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-11T14:44:13.151 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-11T14:44:13.250 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-11T14:44:13.250 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=7 expected=7 2024-09-11T14:44:13.250 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:566253c9:::13:head 2024-09-11T14:44:13.250 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-11T14:44:13.355 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:566253c9:::13:head -> 13 2024-09-11T14:44:13.355 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=13 expected=13 2024-09-11T14:44:13.355 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:cfc208b3:::3:head 2024-09-11T14:44:13.355 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-11T14:44:13.386 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-11T14:44:13.386 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=3 expected=3 2024-09-11T14:44:13.386 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-11T14:44:13.386 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-11T14:44:13.424 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-11T14:44:13.424 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=6 expected=6 2024-09-11T14:44:13.424 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-11T14:44:13.424 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-11T14:44:13.465 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-11T14:44:13.465 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=8 expected=8 2024-09-11T14:44:13.466 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:02547ec2:::1:head 2024-09-11T14:44:13.466 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-11T14:44:13.615 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:02547ec2:::1:head -> 1 2024-09-11T14:44:13.615 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=1 expected=1 2024-09-11T14:44:13.616 INFO:tasks.workunit.client.0.smithi052.stdout:: seek to 76:62a1935d:::14:head 2024-09-11T14:44:13.616 INFO:tasks.workunit.client.0.smithi052.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-11T14:44:13.728 INFO:tasks.workunit.client.0.smithi052.stdout:> 76:62a1935d:::14:head -> 14 2024-09-11T14:44:13.728 INFO:tasks.workunit.client.0.smithi052.stdout:: entry=14 expected=14 2024-09-11T14:44:14.180 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.ListObjectsCursor (3301 ms) 2024-09-11T14:44:14.180 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-11T14:44:15.130 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.EnumerateObjects (949 ms) 2024-09-11T14:44:15.130 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-11T14:44:15.480 INFO:tasks.workunit.client.0.smithi052.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-11T14:44:15.516 INFO:tasks.workunit.client.0.smithi052.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-11T14:44:15.552 INFO:tasks.workunit.client.0.smithi052.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-11T14:44:15.590 INFO:tasks.workunit.client.0.smithi052.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-11T14:44:15.625 INFO:tasks.workunit.client.0.smithi052.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-11T14:44:16.131 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (1002 ms) 2024-09-11T14:44:16.529 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from LibRadosList (8627 ms total) 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosListEC 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:70: Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:44:16.530 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:78: Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:16.531 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosListNP 2024-09-11T14:44:16.532 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-11T14:44:19.541 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosListNP.ListObjectsError (3012 ms) 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosListNP (3012 ms total) 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 11 tests from 3 test suites ran. (13470 ms total) 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 8 tests. 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-11T14:44:19.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-11T14:44:19.544 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:44:19.544 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:44:19.545 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_lock 2024-09-11T14:44:19.567 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:44:19.567 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:44:19.567 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:44:19.567 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLock 2024-09-11T14:44:21.505 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-11T14:44:21.871 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.LockExclusive (366 ms) 2024-09-11T14:44:21.872 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-11T14:44:21.928 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.LockShared (56 ms) 2024-09-11T14:44:21.928 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-11T14:44:23.015 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1087 ms) 2024-09-11T14:44:23.015 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-11T14:44:24.082 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.LockSharedDur (1067 ms) 2024-09-11T14:44:24.082 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-11T14:44:24.146 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.LockMayRenew (65 ms) 2024-09-11T14:44:24.146 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-11T14:44:24.220 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.Unlock (73 ms) 2024-09-11T14:44:24.220 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-11T14:44:24.305 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.ListLockers (85 ms) 2024-09-11T14:44:24.305 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-11T14:44:24.359 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLock.BreakLock (54 ms) 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLock (2853 ms total) 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.560 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (1 ms) 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.561 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.562 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.563 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLockEC (1 ms total) 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 16 tests from 2 test suites ran. (4992 ms total) 2024-09-11T14:44:24.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 8 tests. 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-11T14:44:24.565 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-11T14:44:24.566 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:44:24.566 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:44:24.566 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_lock_pp 2024-09-11T14:44:24.585 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:44:24.585 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:44:24.586 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:44:24.586 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-11T14:44:24.586 INFO:tasks.workunit.client.0.smithi052.stdout:seed 31028 2024-09-11T14:44:26.507 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-11T14:44:26.877 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (370 ms) 2024-09-11T14:44:26.877 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-11T14:44:26.948 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.LockSharedPP (71 ms) 2024-09-11T14:44:26.948 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-11T14:44:28.008 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1060 ms) 2024-09-11T14:44:28.008 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-11T14:44:29.084 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1075 ms) 2024-09-11T14:44:29.084 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-11T14:44:29.155 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (71 ms) 2024-09-11T14:44:29.155 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-11T14:44:29.222 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.UnlockPP (68 ms) 2024-09-11T14:44:29.222 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-11T14:44:29.300 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.ListLockersPP (78 ms) 2024-09-11T14:44:29.300 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-11T14:44:29.363 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosLockPP.BreakLockPP (63 ms) 2024-09-11T14:44:29.573 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLockPP (2856 ms total) 2024-09-11T14:44:29.573 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:29.573 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-11T14:44:29.573 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:44:29.573 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.573 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T14:44:29.574 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.576 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:29.577 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 16 tests from 2 test suites ran. (4987 ms total) 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 8 tests. 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-11T14:44:29.578 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-11T14:44:29.579 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:44:29.579 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:44:29.579 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_misc 2024-09-11T14:44:29.617 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:29.615+0000 7fed7c8806c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:29.617 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:29.615+0000 7fed7c8806c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:29.617 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:29.616+0000 7fed7c8806c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-11T14:44:29.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-11T14:44:29.687 INFO:tasks.workunit.client.0.smithi052.stderr:unable to get monitor info from DNS SRV with service name: 2024-09-11T14:44:29.686+0000 7fed7c8806c0 -1 failed for service _ceph-mon._tcp 2024-09-11T14:44:29.687 INFO:tasks.workunit.client.0.smithi052.stderr:ceph-mon 2024-09-11T14:44:29.687 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:44:29.686+0000 7fed7c8806c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-11T14:44:29.688 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (70 ms) 2024-09-11T14:44:29.688 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-11T14:44:34.698 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5011 ms) 2024-09-11T14:44:34.699 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5081 ms total) 2024-09-11T14:44:34.699 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:34.699 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-11T14:44:34.699 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-11T14:44:37.051 INFO:tasks.workunit.client.0.smithi052.stdout:started 0x7fed40005de0 2024-09-11T14:44:38.052 INFO:tasks.workunit.client.0.smithi052.stdout:started 0x7fed5c005ce0 2024-09-11T14:44:38.052 INFO:tasks.workunit.client.0.smithi052.stdout: started 2 aios 2024-09-11T14:44:38.052 INFO:tasks.workunit.client.0.smithi052.stdout:waiting 0x7fed40005de0 2024-09-11T14:44:38.052 INFO:tasks.workunit.client.0.smithi052.stdout:waiting 0x7fed5c005ce0 2024-09-11T14:44:38.055 INFO:tasks.workunit.client.0.smithi052.stdout:done. 2024-09-11T14:44:40.074 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5375 ms) 2024-09-11T14:44:40.074 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscPool (5375 ms total) 2024-09-11T14:44:40.074 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:44:40.074 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosMisc 2024-09-11T14:44:41.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-11T14:44:41.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-11T14:44:41.510 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-11T14:44:41.844 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.Exec (334 ms) 2024-09-11T14:44:41.844 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-11T14:44:41.930 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.WriteSame (86 ms) 2024-09-11T14:44:41.930 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-11T14:44:41.967 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.CmpExt (37 ms) 2024-09-11T14:44:41.968 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-11T14:44:46.530 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.Applications (4562 ms) 2024-09-11T14:44:46.530 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-11T14:44:46.530 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-11T14:44:46.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-11T14:44:46.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-11T14:44:46.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-11T14:45:15.241 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMisc.ShutdownRace (28711 ms) 2024-09-11T14:45:15.532 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 8 tests from LibRadosMisc (33731 ms total) 2024-09-11T14:45:15.533 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:15.533 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:45:15.533 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 12 tests from 4 test suites ran. (45915 ms total) 2024-09-11T14:45:15.533 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 12 tests. 2024-09-11T14:45:15.544 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:45:15.544 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:45:15.544 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_misc_pp 2024-09-11T14:45:15.583 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:45:15.581+0000 7ffb0a90d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:15.584 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:45:15.581+0000 7ffb0a90d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:15.584 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:45:15.581+0000 7ffb0a90d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:15.584 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-11T14:45:15.584 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:45:15.584 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-11T14:45:15.585 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-11T14:45:15.585 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-11T14:45:15.585 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T14:45:15.585 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:15.585 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-11T14:45:15.585 INFO:tasks.workunit.client.0.smithi052.stdout:seed 92693 2024-09-11T14:45:17.523 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-11T14:45:17.523 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2024-09-11T14:45:17.523 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-11T14:45:18.190 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.LongNamePP (666 ms) 2024-09-11T14:45:18.190 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-11T14:45:18.190 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-11T14:45:18.190 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:18.190 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-11T14:45:18.190 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-11T14:45:18.285 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (95 ms) 2024-09-11T14:45:18.285 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-11T14:45:18.363 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (79 ms) 2024-09-11T14:45:18.363 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-11T14:45:18.388 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.ExecPP (25 ms) 2024-09-11T14:45:18.388 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-11T14:45:18.415 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (26 ms) 2024-09-11T14:45:18.415 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-11T14:45:18.458 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.Operate1PP (43 ms) 2024-09-11T14:45:18.458 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-11T14:45:18.488 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.Operate2PP (30 ms) 2024-09-11T14:45:18.488 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-11T14:45:18.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (140 ms) 2024-09-11T14:45:18.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-11T14:45:18.659 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (31 ms) 2024-09-11T14:45:18.659 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-11T14:45:18.701 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (42 ms) 2024-09-11T14:45:18.701 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-11T14:45:18.776 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (75 ms) 2024-09-11T14:45:18.776 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-11T14:45:18.801 INFO:tasks.workunit.client.0.smithi052.stdout:osd_max_attr_size = 0 2024-09-11T14:45:18.801 INFO:tasks.workunit.client.0.smithi052.stdout:osd_max_attr_size == 0; skipping test 2024-09-11T14:45:45.886 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (27110 ms) 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-11T14:45:45.887 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-11T14:45:45.953 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (68 ms) 2024-09-11T14:45:45.953 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-11T14:45:45.989 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (35 ms) 2024-09-11T14:45:45.989 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-11T14:45:49.536 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.Applications (3547 ms) 2024-09-11T14:45:49.536 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-11T14:45:49.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-11T14:45:49.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-11T14:45:49.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-11T14:45:49.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-11T14:45:49.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-11T14:45:50.539 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 22 tests from LibRadosMiscPP (32013 ms total) 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (1 ms) 2024-09-11T14:45:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-11T14:45:50.541 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:50.541 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (1 ms total) 2024-09-11T14:45:50.541 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:50.541 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-11T14:45:52.553 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-11T14:45:52.994 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosChecksum/0.Subset (442 ms) 2024-09-11T14:45:52.995 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-11T14:45:53.030 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosChecksum/0.Chunked (35 ms) 2024-09-11T14:45:53.557 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosChecksum/0 (477 ms total) 2024-09-11T14:45:53.557 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:53.557 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-11T14:45:55.564 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-11T14:45:55.883 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosChecksum/1.Subset (319 ms) 2024-09-11T14:45:55.884 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-11T14:45:55.959 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosChecksum/1.Chunked (75 ms) 2024-09-11T14:45:56.528 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosChecksum/1 (394 ms total) 2024-09-11T14:45:56.528 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:56.529 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-11T14:45:58.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-11T14:45:58.841 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosChecksum/2.Subset (266 ms) 2024-09-11T14:45:58.842 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-11T14:45:59.008 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosChecksum/2.Chunked (167 ms) 2024-09-11T14:45:59.580 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosChecksum/2 (433 ms total) 2024-09-11T14:45:59.580 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (1 ms) 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:45:59.581 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosMiscECPP (1 ms total) 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 31 tests from 7 test suites ran. (43997 ms total) 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 26 tests. 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T14:45:59.582 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T14:45:59.583 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:45:59.583 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:45:59.583 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_tier_pp 2024-09-11T14:45:59.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:45:59.630+0000 7f9c02e2e9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:59.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:45:59.630+0000 7f9c02e2e9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:59.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:45:59.630+0000 7f9c02e2e9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:45:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-11T14:45:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:45:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-11T14:45:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:seed 92767 2024-09-11T14:46:01.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-11T14:46:01.591 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:01.592 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-11T14:46:02.593 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-11T14:46:02.593 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:46:02.593 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-11T14:46:04.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-11T14:46:04.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-11T14:46:04.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T14:46:04.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-11T14:46:04.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T14:46:04.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-11T14:46:04.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.627 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-11T14:46:04.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T14:46:04.629 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:46:04.629 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.629 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:46:04.629 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:04.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (0 ms total) 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:46:05.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-11T14:46:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T14:46:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-11T14:46:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-11T14:46:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T14:46:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T14:46:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.620 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.621 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.621 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-11T14:46:05.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T14:46:05.621 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.621 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-11T14:46:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T14:46:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.623 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.624 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-11T14:46:05.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T14:46:05.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:46:05.624 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.624 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:46:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 77 tests from 4 test suites ran. (5975 ms total) 2024-09-11T14:46:05.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 0 tests. 2024-09-11T14:46:05.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-11T14:46:05.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-11T14:46:05.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-11T14:46:05.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-11T14:46:05.626 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-11T14:46:05.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-11T14:46:05.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T14:46:05.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T14:46:05.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T14:46:05.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T14:46:05.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T14:46:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-11T14:46:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T14:46:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T14:46:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T14:46:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T14:46:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T14:46:05.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T14:46:05.630 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T14:46:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-11T14:46:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T14:46:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T14:46:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T14:46:05.635 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:46:05.635 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:46:05.635 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_pool 2024-09-11T14:46:05.635 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:46:05.635 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-11T14:46:05.635 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:46:05.636 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 9 tests from LibRadosPools 2024-09-11T14:46:05.636 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-11T14:46:08.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolList (2899 ms) 2024-09-11T14:46:08.531 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-11T14:46:11.549 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolLookup (3019 ms) 2024-09-11T14:46:11.549 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-11T14:46:14.559 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolLookup2 (3009 ms) 2024-09-11T14:46:14.559 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-11T14:46:17.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (2978 ms) 2024-09-11T14:46:17.537 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-11T14:46:20.581 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3043 ms) 2024-09-11T14:46:20.581 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-11T14:46:25.603 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolDelete (5023 ms) 2024-09-11T14:46:25.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-11T14:46:30.545 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4941 ms) 2024-09-11T14:46:30.545 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-11T14:46:35.571 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5027 ms) 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/pool.cc:139: Skipped 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 9 tests from LibRadosPools (29940 ms total) 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 9 tests from 1 test suite ran. (29940 ms total) 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 8 tests. 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:46:35.572 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-11T14:46:35.574 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:46:35.575 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:46:35.575 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_snapshots 2024-09-11T14:46:35.598 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:46:35.598 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-11T14:46:35.598 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:46:35.598 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-11T14:46:37.541 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-11T14:46:39.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshots.SnapList (2034 ms) 2024-09-11T14:46:39.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-11T14:46:41.584 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2009 ms) 2024-09-11T14:46:41.584 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-11T14:46:43.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshots.Rollback (2010 ms) 2024-09-11T14:46:43.594 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-11T14:46:45.601 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2007 ms) 2024-09-11T14:46:46.538 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosSnapshots (8060 ms total) 2024-09-11T14:46:46.538 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:46:46.538 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-11T14:46:48.545 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-11T14:46:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4091 ms) 2024-09-11T14:46:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-11T14:46:56.642 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4006 ms) 2024-09-11T14:46:56.642 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-11T14:47:01.735 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5094 ms) 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13191 ms total) 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.604 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.605 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosSnapshotsEC (1 ms total) 2024-09-11T14:47:02.606 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T14:47:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 13 tests from 4 test suites ran. (27005 ms total) 2024-09-11T14:47:02.608 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 7 tests. 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T14:47:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T14:47:02.610 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:47:02.610 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:47:02.610 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-11T14:47:02.625 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:47:02.626 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-11T14:47:02.626 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:47:02.626 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-11T14:47:02.626 INFO:tasks.workunit.client.0.smithi052.stdout:seed 93023 2024-09-11T14:47:04.613 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-11T14:47:06.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (1930 ms) 2024-09-11T14:47:06.542 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-11T14:47:08.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2081 ms) 2024-09-11T14:47:08.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-11T14:47:10.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2005 ms) 2024-09-11T14:47:10.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-11T14:47:12.639 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2010 ms) 2024-09-11T14:47:12.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-11T14:47:16.545 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3905 ms) 2024-09-11T14:47:17.552 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11932 ms total) 2024-09-11T14:47:17.552 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:47:17.552 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-11T14:47:19.561 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-11T14:47:23.670 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4110 ms) 2024-09-11T14:47:23.671 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-11T14:47:27.547 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3876 ms) 2024-09-11T14:47:27.547 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-11T14:47:33.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6028 ms) 2024-09-11T14:47:33.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-11T14:47:37.553 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3978 ms) 2024-09-11T14:47:37.553 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-11T14:47:39.675 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2122 ms) 2024-09-11T14:47:39.675 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-11T14:47:39.675 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-11T14:47:39.675 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:47:39.675 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-11T14:47:39.676 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-11T14:47:41.570 INFO:tasks.workunit.client.0.smithi052.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi052-93023-7 2024-09-11T14:47:42.575 INFO:tasks.workunit.client.0.smithi052.stdout:waiting for snaps to purge 2024-09-11T14:47:57.624 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17949 ms) 2024-09-11T14:47:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38063 ms total) 2024-09-11T14:47:58.555 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:47:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-11T14:47:58.555 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-11T14:47:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (7 ms) 2024-09-11T14:47:58.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-11T14:48:03.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5068 ms) 2024-09-11T14:48:03.633 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5075 ms total) 2024-09-11T14:48:03.633 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.634 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-11T14:48:03.635 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.636 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-11T14:48:03.637 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:48:03.637 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.637 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-11T14:48:03.637 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:03.637 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-11T14:48:03.637 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.638 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:48:03.639 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 21 tests from 5 test suites ran. (61005 ms total) 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 13 tests. 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T14:48:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T14:48:03.641 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:48:03.641 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:48:03.641 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_stat 2024-09-11T14:48:03.659 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:48:03.659 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-11T14:48:03.659 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:48:03.659 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from LibRadosStat 2024-09-11T14:48:05.590 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStat.Stat 2024-09-11T14:48:06.137 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStat.Stat (548 ms) 2024-09-11T14:48:06.138 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-11T14:48:06.177 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStat.Stat2 (40 ms) 2024-09-11T14:48:06.177 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-11T14:48:06.277 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStat.StatNS (99 ms) 2024-09-11T14:48:06.277 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-11T14:48:06.277 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStat.ClusterStat (1 ms) 2024-09-11T14:48:06.277 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-11T14:48:06.301 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStat.PoolStat (24 ms) 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from LibRadosStat (712 ms total) 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.595 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.596 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:06.597 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 9 tests from 2 test suites ran. (2935 ms total) 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 5 tests. 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:48:06.598 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:48:06.599 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_stat_pp 2024-09-11T14:48:06.616 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:48:06.616 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-11T14:48:06.616 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:48:06.617 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-11T14:48:06.617 INFO:tasks.workunit.client.0.smithi052.stdout:seed 93160 2024-09-11T14:48:08.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-11T14:48:09.137 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStatPP.StatPP (534 ms) 2024-09-11T14:48:09.137 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-11T14:48:09.187 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (50 ms) 2024-09-11T14:48:09.187 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-11T14:48:09.187 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-11T14:48:09.187 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-11T14:48:09.214 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStatPP.PoolStatPP (27 ms) 2024-09-11T14:48:09.214 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-11T14:48:09.306 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosStatPP.StatPPNS (92 ms) 2024-09-11T14:48:09.608 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from LibRadosStatPP (703 ms total) 2024-09-11T14:48:09.608 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:09.609 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.610 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 9 tests from 2 test suites ran. (2991 ms total) 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 5 tests. 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-11T14:48:09.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-11T14:48:09.612 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:48:09.612 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:48:09.612 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_watch_notify 2024-09-11T14:48:09.629 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:48:09.629 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-11T14:48:09.629 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:48:09.629 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-11T14:48:11.557 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-11T14:48:11.964 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify_test_cb 2024-09-11T14:48:12.017 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (460 ms) 2024-09-11T14:48:12.017 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-11T14:48:12.160 INFO:tasks.workunit.client.0.smithi052.stdout:waiting up to 300 for disconnect notification ... 2024-09-11T14:48:14.674 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_errcb cookie 8938640 err -107 2024-09-11T14:48:15.174 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3158 ms) 2024-09-11T14:48:15.174 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-11T14:48:15.255 INFO:tasks.workunit.client.0.smithi052.stdout:waiting up to 300 for disconnect notification ... 2024-09-11T14:48:19.675 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_errcb cookie 8964528 err -107 2024-09-11T14:48:20.270 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5096 ms) 2024-09-11T14:48:20.271 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-11T14:48:20.331 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656768 cookie 8978272 2024-09-11T14:48:20.367 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (97 ms) 2024-09-11T14:48:20.367 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-11T14:48:20.419 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656769 cookie 8978272 2024-09-11T14:48:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (80 ms) 2024-09-11T14:48:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-11T14:48:20.494 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656768 cookie 9019248 2024-09-11T14:48:20.521 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.AioNotify (73 ms) 2024-09-11T14:48:20.521 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-11T14:48:20.591 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656770 cookie 9005968 2024-09-11T14:48:20.592 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656770 cookie 9019248 2024-09-11T14:48:20.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (113 ms) 2024-09-11T14:48:20.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-11T14:48:20.677 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656769 cookie 9019248 2024-09-11T14:48:23.678 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656770 cookie 9019248 2024-09-11T14:48:23.708 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3073 ms) 2024-09-11T14:48:23.708 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-11T14:48:23.754 INFO:tasks.workunit.client.0.smithi052.stdout:waiting up to 1024 for osd to time us out ... 2024-09-11T14:48:27.774 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_errcb cookie 9019248 err -107 2024-09-11T14:48:28.789 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_cb from 15494 notify_id 1752346656770 cookie 9019248 2024-09-11T14:48:28.813 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5106 ms) 2024-09-11T14:48:28.813 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-11T14:48:28.883 INFO:tasks.workunit.client.0.smithi052.stdout:waiting up to 30 for disconnect notification ... 2024-09-11T14:48:29.676 INFO:tasks.workunit.client.0.smithi052.stdout:watch_notify2_test_errcb cookie 9019248 err -107 2024-09-11T14:48:29.895 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (1082 ms) 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 10 tests from LibRadosWatchNotify (18338 ms total) 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:48:30.575 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 11 tests from 2 test suites ran. (20945 ms total) 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 10 tests. 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:48:30.576 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T14:48:30.577 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:48:30.577 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:48:30.577 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:30.601 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4872-g0d61375b/rpm/el9/BUILD/ceph-19.3.0-4872-g0d61375b/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:48:30.602 INFO:tasks.workunit.client.0.smithi052.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:48:30.603 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-11T14:48:30.603 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:30.603 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-11T14:48:32.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-11T14:48:32.998 INFO:tasks.workunit.client.0.smithi052.stdout:notify 2024-09-11T14:48:33.031 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (470 ms) 2024-09-11T14:48:33.032 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-11T14:48:33.084 INFO:tasks.workunit.client.0.smithi052.stdout:notify 2024-09-11T14:48:33.105 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (74 ms) 2024-09-11T14:48:33.105 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-11T14:48:33.162 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (57 ms) 2024-09-11T14:48:33.162 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-11T14:48:33.217 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (55 ms) 2024-09-11T14:48:33.217 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-11T14:48:33.270 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16005456 notify_id 1765231558660 notifier_gid 15497 2024-09-11T14:48:33.291 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (74 ms) 2024-09-11T14:48:33.292 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-11T14:48:33.343 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16005456 notify_id 1765231558661 notifier_gid 15497 2024-09-11T14:48:33.365 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (74 ms) 2024-09-11T14:48:33.365 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-11T14:48:33.412 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16008480 notify_id 1765231558659 notifier_gid 15497 2024-09-11T14:48:33.432 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (66 ms) 2024-09-11T14:48:33.432 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-11T14:48:33.486 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16008480 notify_id 1765231558659 notifier_gid 15497 2024-09-11T14:48:33.507 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (75 ms) 2024-09-11T14:48:33.507 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-11T14:48:33.553 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16022800 notify_id 1765231558662 notifier_gid 15497 2024-09-11T14:48:33.573 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (67 ms) 2024-09-11T14:48:33.574 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-11T14:48:33.673 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16008480 notify_id 1765231558660 notifier_gid 15497 2024-09-11T14:48:33.711 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (138 ms) 2024-09-11T14:48:33.712 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-11T14:48:33.758 INFO:tasks.workunit.client.0.smithi052.stdout: trying... 2024-09-11T14:48:33.762 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16022800 notify_id 1765231558660 notifier_gid 15497 2024-09-11T14:48:34.760 INFO:tasks.workunit.client.0.smithi052.stdout: timed out 2024-09-11T14:48:34.783 INFO:tasks.workunit.client.0.smithi052.stdout: flushing 2024-09-11T14:48:36.763 INFO:tasks.workunit.client.0.smithi052.stdout: flushed 2024-09-11T14:48:36.763 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3051 ms) 2024-09-11T14:48:36.763 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-11T14:48:36.822 INFO:tasks.workunit.client.0.smithi052.stdout: trying... 2024-09-11T14:48:36.827 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16022800 notify_id 1765231558661 notifier_gid 15497 2024-09-11T14:48:37.826 INFO:tasks.workunit.client.0.smithi052.stdout: timed out 2024-09-11T14:48:37.846 INFO:tasks.workunit.client.0.smithi052.stdout: flushing 2024-09-11T14:48:39.828 INFO:tasks.workunit.client.0.smithi052.stdout: flushed 2024-09-11T14:48:39.828 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3065 ms) 2024-09-11T14:48:39.828 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-11T14:48:39.886 INFO:tasks.workunit.client.0.smithi052.stdout:List watches 2024-09-11T14:48:39.886 INFO:tasks.workunit.client.0.smithi052.stdout:notify2 2024-09-11T14:48:39.890 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16022800 notify_id 1765231558657 notifier_gid 15497 2024-09-11T14:48:42.896 INFO:tasks.workunit.client.0.smithi052.stdout:notify2 done 2024-09-11T14:48:42.896 INFO:tasks.workunit.client.0.smithi052.stdout:watch_check 2024-09-11T14:48:42.896 INFO:tasks.workunit.client.0.smithi052.stdout:unwatch2 2024-09-11T14:48:42.920 INFO:tasks.workunit.client.0.smithi052.stdout: flushing 2024-09-11T14:48:42.920 INFO:tasks.workunit.client.0.smithi052.stdout:done 2024-09-11T14:48:42.920 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3092 ms) 2024-09-11T14:48:42.920 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-11T14:48:42.978 INFO:tasks.workunit.client.0.smithi052.stdout:List watches 2024-09-11T14:48:42.978 INFO:tasks.workunit.client.0.smithi052.stdout:notify2 2024-09-11T14:48:42.982 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16022800 notify_id 1769526525959 notifier_gid 15497 2024-09-11T14:48:45.987 INFO:tasks.workunit.client.0.smithi052.stdout:notify2 done 2024-09-11T14:48:45.987 INFO:tasks.workunit.client.0.smithi052.stdout:watch_check 2024-09-11T14:48:45.987 INFO:tasks.workunit.client.0.smithi052.stdout:unwatch2 2024-09-11T14:48:46.008 INFO:tasks.workunit.client.0.smithi052.stdout: flushing 2024-09-11T14:48:46.008 INFO:tasks.workunit.client.0.smithi052.stdout:done 2024-09-11T14:48:46.008 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3089 ms) 2024-09-11T14:48:46.574 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (13447 ms total) 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 16 tests from 2 test suites ran. (15974 ms total) 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 14 tests. 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T14:48:46.575 INFO:tasks.workunit.client.0.smithi052.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T14:48:46.576 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:48:46.577 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:48:46.577 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_cmd 2024-09-11T14:48:46.600 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:48:46.600 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:48:46.600 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:48:46.600 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosCmd 2024-09-11T14:48:46.600 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-11T14:48:46.644 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.MonDescribe (43 ms) 2024-09-11T14:48:46.644 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-11T14:48:46.832 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.OSDCmd (187 ms) 2024-09-11T14:48:46.832 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-11T14:48:49.587 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.PGCmd (2755 ms) 2024-09-11T14:48:49.587 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-11T14:48:49.620 INFO:tasks.workunit.client.0.smithi052.stdout:got: 2024-09-11T14:48:48.572910+0000 mon.a [INF] from='client.? 172.21.15.52:0/3555959238' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi052-93219-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T14:48:50.582 INFO:tasks.workunit.client.0.smithi052.stdout:got: 2024-09-11T14:48:49.620071+0000 client.admin [INF] onexx 2024-09-11T14:48:50.583 INFO:tasks.workunit.client.0.smithi052.stdout:got: 2024-09-11T14:48:49.620201+0000 mon.a [INF] from='client.? 172.21.15.52:0/1432005950' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-11T14:48:54.587 INFO:tasks.workunit.client.0.smithi052.stdout:got: 2024-09-11T14:48:52.586008+0000 mon.a [INF] from='client.? 172.21.15.52:0/1432005950' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T14:48:54.591 INFO:tasks.workunit.client.0.smithi052.stdout:got: 2024-09-11T14:48:54.586882+0000 client.admin [INF] threexx 2024-09-11T14:48:54.591 INFO:tasks.workunit.client.0.smithi052.stdout:got: 2024-09-11T14:48:54.587175+0000 mon.a [INF] from='client.? 172.21.15.52:0/1432005950' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-11T14:48:58.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.WatchLog (9011 ms) 2024-09-11T14:48:58.598 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosCmd (11997 ms total) 2024-09-11T14:48:58.598 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:48:58.598 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:48:58.598 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 4 tests from 1 test suite ran. (11997 ms total) 2024-09-11T14:48:58.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 4 tests. 2024-09-11T14:48:58.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:48:58.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:48:58.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-11T14:48:58.624 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:48:58.625 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:48:58.625 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:48:58.625 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosCmd 2024-09-11T14:48:58.625 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-11T14:48:58.662 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-09-11T14:48:58.662 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-11T14:48:58.701 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.OSDCmdPP (39 ms) 2024-09-11T14:48:58.701 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-11T14:49:01.801 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCmd.PGCmdPP (3100 ms) 2024-09-11T14:49:01.801 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from LibRadosCmd (3176 ms total) 2024-09-11T14:49:01.801 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:01.802 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:49:01.802 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 3 tests from 1 test suite ran. (3176 ms total) 2024-09-11T14:49:01.802 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 3 tests. 2024-09-11T14:49:01.804 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:49:01.804 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:49:01.804 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_service 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:49:01.840+0000 7f37fc837840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:49:01.841+0000 7f37fc837840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:49:01.841+0000 7f37fc837840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosService 2024-09-11T14:49:01.842 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-11T14:49:06.876 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosService.RegisterEarly (5033 ms) 2024-09-11T14:49:06.876 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-11T14:49:06.908 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosService.RegisterLate (32 ms) 2024-09-11T14:49:06.908 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-11T14:49:07.090 INFO:tasks.workunit.client.0.smithi052.stdout: cluster: 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: id: a6b5d4a4-66d9-4a76-9e4a-eb916006be26 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: health: HEALTH_WARN 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: 1 pool(s) do not have an application enabled 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: services: 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: mgr: x(active, since 10m) 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: laundry: 1 daemon active (1 hosts) 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: data: 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: pools: 3 pools, 41 pgs 2024-09-11T14:49:07.091 INFO:tasks.workunit.client.0.smithi052.stdout: objects: 5 objects, 577 KiB 2024-09-11T14:49:07.092 INFO:tasks.workunit.client.0.smithi052.stdout: usage: 20 MiB used, 199 GiB / 200 GiB avail 2024-09-11T14:49:07.092 INFO:tasks.workunit.client.0.smithi052.stdout: pgs: 41 active+clean 2024-09-11T14:49:07.092 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:07.092 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: cluster: 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: id: a6b5d4a4-66d9-4a76-9e4a-eb916006be26 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: health: HEALTH_WARN 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: 1 pool(s) do not have an application enabled 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: services: 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: mgr: x(active, since 10m) 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-11T14:49:09.122 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: data: 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: pools: 3 pools, 41 pgs 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: objects: 5 objects, 577 KiB 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: usage: 20 MiB used, 199 GiB / 200 GiB avail 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: pgs: 41 active+clean 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:09.123 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:09.149 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosService.StatusFormat (2241 ms) 2024-09-11T14:49:09.149 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosService.Status 2024-09-11T14:49:29.181 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosService.Status (20032 ms) 2024-09-11T14:49:29.181 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosService (27338 ms total) 2024-09-11T14:49:29.181 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:29.181 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:49:29.181 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 4 tests from 1 test suite ran. (27338 ms total) 2024-09-11T14:49:29.181 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 4 tests. 2024-09-11T14:49:29.186 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:49:29.186 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:49:29.186 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_service_pp 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:49:29.219+0000 7f9d33c81840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:49:29.219+0000 7f9d33c81840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:49:29.220+0000 7f9d33c81840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-11T14:49:29.222 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-11T14:49:34.252 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5029 ms) 2024-09-11T14:49:34.252 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-11T14:49:34.304 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosServicePP.RegisterLate (50 ms) 2024-09-11T14:49:34.304 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-11T14:49:54.338 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosServicePP.Status (20031 ms) 2024-09-11T14:49:54.338 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-11T14:49:54.338 INFO:tasks.workunit.client.0.smithi052.stdout:attempt 0 of 20 2024-09-11T14:49:59.395 INFO:tasks.workunit.client.0.smithi052.stdout: failed to deregister: 2024-09-11T14:49:59.395 INFO:tasks.workunit.client.0.smithi052.stdout:{ 2024-09-11T14:49:59.395 INFO:tasks.workunit.client.0.smithi052.stdout: "epoch": 9, 2024-09-11T14:49:59.395 INFO:tasks.workunit.client.0.smithi052.stdout: "modified": "2024-09-11T14:49:55.068112+0000", 2024-09-11T14:49:59.395 INFO:tasks.workunit.client.0.smithi052.stdout: "services": { 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "laundry": { 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "daemons": { 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "summary": "", 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "close-test-pid93672": { 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "start_epoch": 9, 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "start_stamp": "2024-09-11T14:49:54.363395+0000", 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "gid": 15590, 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "addr": "172.21.15.52:0/1039584916", 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "metadata": { 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "arch": "x86_64", 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "ceph_release": "squid", 2024-09-11T14:49:59.396 INFO:tasks.workunit.client.0.smithi052.stdout: "ceph_version": "ceph version 19.3.0-4872-g0d61375b (0d61375b8ab53be4c233f5b93e463edfdff9316a) squid (dev)", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "ceph_version_short": "19.3.0-4872-g0d61375b", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "distro": "centos", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "distro_description": "CentOS Stream 9", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "distro_version": "9", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "foo": "bar", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "hostname": "smithi052", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "kernel_version": "5.14.0-505.el9.x86_64", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "mem_swap_kb": "0", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "mem_total_kb": "32493492", 2024-09-11T14:49:59.397 INFO:tasks.workunit.client.0.smithi052.stdout: "os": "Linux", 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: "this": "that" 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: }, 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: "task_status": {} 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: } 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: } 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: } 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: } 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout:} 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:49:59.398 INFO:tasks.workunit.client.0.smithi052.stdout:attempt 1 of 20 2024-09-11T14:50:04.456 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosServicePP.Close (10124 ms) 2024-09-11T14:50:04.457 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 4 tests from LibRadosServicePP (35234 ms total) 2024-09-11T14:50:04.457 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:50:04.457 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:50:04.457 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 4 tests from 1 test suite ran. (35234 ms total) 2024-09-11T14:50:04.457 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 4 tests. 2024-09-11T14:50:04.459 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:50:04.459 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:50:04.459 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-11T14:50:04.482 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-11T14:50:06.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.assertExists (2127 ms) 2024-09-11T14:50:06.609 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-11T14:50:09.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3017 ms) 2024-09-11T14:50:09.627 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-11T14:50:12.637 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3010 ms) 2024-09-11T14:50:12.637 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-11T14:50:15.650 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.Write (3013 ms) 2024-09-11T14:50:15.650 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-11T14:50:18.651 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.Exec (3001 ms) 2024-09-11T14:50:18.651 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-11T14:50:21.663 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3013 ms) 2024-09-11T14:50:21.663 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-11T14:50:36.140 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] LibRadosCWriteOps.CmpExt (14476 ms) 2024-09-11T14:50:36.140 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from LibRadosCWriteOps (31658 ms total) 2024-09-11T14:50:36.140 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:50:36.140 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:50:36.140 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 8 tests from 2 test suites ran. (31658 ms total) 2024-09-11T14:50:36.140 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 8 tests. 2024-09-11T14:50:36.141 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:50:36.142 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:50:36.142 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-11T14:50:36.161 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:50:36.161 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-11T14:50:36.161 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:50:36.161 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 17 tests from CReadOpsTest 2024-09-11T14:50:37.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-11T14:50:37.597 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-11T14:50:37.598 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-11T14:50:38.130 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.SetOpFlags (532 ms) 2024-09-11T14:50:38.130 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-11T14:50:38.224 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.AssertExists (95 ms) 2024-09-11T14:50:38.224 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-11T14:50:38.303 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.AssertVersion (79 ms) 2024-09-11T14:50:38.303 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-11T14:50:38.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.CmpXattr (259 ms) 2024-09-11T14:50:38.562 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.Read 2024-09-11T14:50:38.654 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.Read (92 ms) 2024-09-11T14:50:38.654 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-11T14:50:38.720 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.Checksum (65 ms) 2024-09-11T14:50:38.720 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-11T14:50:38.770 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.RWOrderedRead (50 ms) 2024-09-11T14:50:38.770 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-11T14:50:38.848 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.ShortRead (78 ms) 2024-09-11T14:50:38.848 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-11T14:50:38.896 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.Exec (49 ms) 2024-09-11T14:50:38.896 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-11T14:50:38.952 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.ExecUserBuf (55 ms) 2024-09-11T14:50:38.952 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-11T14:50:39.010 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.Stat (58 ms) 2024-09-11T14:50:39.010 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-11T14:50:39.063 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.Stat2 (54 ms) 2024-09-11T14:50:39.064 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-11T14:50:39.224 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.Omap (160 ms) 2024-09-11T14:50:39.224 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-11T14:50:39.363 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.OmapNuls (140 ms) 2024-09-11T14:50:39.364 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-11T14:50:39.499 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.GetXattrs (136 ms) 2024-09-11T14:50:39.499 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-11T14:50:39.552 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] CReadOpsTest.CmpExt (53 ms) 2024-09-11T14:50:39.602 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 17 tests from CReadOpsTest (1955 ms total) 2024-09-11T14:50:39.602 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:50:39.602 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:50:39.602 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 17 tests from 1 test suite ran. (3441 ms total) 2024-09-11T14:50:39.602 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 17 tests. 2024-09-11T14:50:39.604 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:50:39.604 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:50:39.604 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_list_parallel 2024-09-11T14:50:43.313 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: starting. 2024-09-11T14:50:43.313 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: creating pool ceph_test_rados_list_parallel.smithi052-93929 2024-09-11T14:50:43.313 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: created object 0... 2024-09-11T14:50:43.313 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: created object 25... 2024-09-11T14:50:43.314 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: created object 49... 2024-09-11T14:50:43.314 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: finishing. 2024-09-11T14:50:43.314 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[93930]: shutting down. 2024-09-11T14:50:43.489 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[93931]: starting. 2024-09-11T14:50:43.490 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[93931]: listing objects. 2024-09-11T14:50:43.490 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[93931]: listed object 0... 2024-09-11T14:50:43.490 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[93931]: listed object 25... 2024-09-11T14:50:43.490 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[93931]: saw 50 objects 2024-09-11T14:50:43.490 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[93931]: shutting down. 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: starting. 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: creating pool ceph_test_rados_list_parallel.smithi052-93929 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: created object 0... 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: created object 25... 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: created object 49... 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: finishing. 2024-09-11T14:50:44.541 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[93966]: shutting down. 2024-09-11T14:50:45.041 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:45.041 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[93967]: starting. 2024-09-11T14:50:45.042 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[93967]: listing objects. 2024-09-11T14:50:45.042 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[93967]: listed object 0... 2024-09-11T14:50:45.042 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[93967]: listed object 25... 2024-09-11T14:50:45.042 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[93967]: saw 43 objects 2024-09-11T14:50:45.042 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[93967]: shutting down. 2024-09-11T14:50:45.538 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:45.538 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[93968]: starting. 2024-09-11T14:50:45.539 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[93968]: removed 25 objects... 2024-09-11T14:50:45.539 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[93968]: removed half of the objects 2024-09-11T14:50:45.539 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[93968]: removed 50 objects... 2024-09-11T14:50:45.539 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[93968]: removed 50 objects 2024-09-11T14:50:45.539 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[93968]: shutting down. 2024-09-11T14:50:46.742 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: starting. 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: creating pool ceph_test_rados_list_parallel.smithi052-93929 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: created object 0... 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: created object 25... 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: created object 49... 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: finishing. 2024-09-11T14:50:46.743 INFO:tasks.workunit.client.0.smithi052.stdout:process_6_[94017]: shutting down. 2024-09-11T14:50:47.379 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: starting. 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: listing objects. 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: listed object 0... 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: listed object 25... 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: listed object 50... 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: saw 53 objects 2024-09-11T14:50:47.380 INFO:tasks.workunit.client.0.smithi052.stdout:process_7_[94018]: shutting down. 2024-09-11T14:50:48.022 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:process_8_[94019]: starting. 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:process_8_[94019]: added 25 objects... 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:process_8_[94019]: added half of the objects 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:process_8_[94019]: added 50 objects... 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:process_8_[94019]: added 50 objects 2024-09-11T14:50:48.023 INFO:tasks.workunit.client.0.smithi052.stdout:process_8_[94019]: shutting down. 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: starting. 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: creating pool ceph_test_rados_list_parallel.smithi052-93929 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: created object 0... 2024-09-11T14:50:49.114 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: created object 25... 2024-09-11T14:50:49.115 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: created object 49... 2024-09-11T14:50:49.115 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: finishing. 2024-09-11T14:50:49.115 INFO:tasks.workunit.client.0.smithi052.stdout:process_9_[94068]: shutting down. 2024-09-11T14:50:49.876 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:49.876 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:49.876 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:49.876 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: starting. 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: listing objects. 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: listed object 0... 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: listed object 25... 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: listed object 50... 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: listed object 75... 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: saw 98 objects 2024-09-11T14:50:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:process_10_[94069]: shutting down. 2024-09-11T14:50:50.673 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:50.673 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:50.673 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:50.674 INFO:tasks.workunit.client.0.smithi052.stdout:process_13_[94072]: starting. 2024-09-11T14:50:50.674 INFO:tasks.workunit.client.0.smithi052.stdout:process_13_[94072]: removed 25 objects... 2024-09-11T14:50:50.674 INFO:tasks.workunit.client.0.smithi052.stdout:process_13_[94072]: removed half of the objects 2024-09-11T14:50:50.674 INFO:tasks.workunit.client.0.smithi052.stdout:process_13_[94072]: removed 50 objects... 2024-09-11T14:50:50.674 INFO:tasks.workunit.client.0.smithi052.stdout:process_13_[94072]: removed 50 objects 2024-09-11T14:50:50.674 INFO:tasks.workunit.client.0.smithi052.stdout:process_13_[94072]: shutting down. 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:process_11_[94070]: starting. 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:process_11_[94070]: added 25 objects... 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:process_11_[94070]: added half of the objects 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:process_11_[94070]: added 50 objects... 2024-09-11T14:50:50.726 INFO:tasks.workunit.client.0.smithi052.stdout:process_11_[94070]: added 50 objects 2024-09-11T14:50:50.727 INFO:tasks.workunit.client.0.smithi052.stdout:process_11_[94070]: shutting down. 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:process_12_[94071]: starting. 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:process_12_[94071]: added 25 objects... 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:process_12_[94071]: added half of the objects 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:process_12_[94071]: added 50 objects... 2024-09-11T14:50:51.052 INFO:tasks.workunit.client.0.smithi052.stdout:process_12_[94071]: added 50 objects 2024-09-11T14:50:51.053 INFO:tasks.workunit.client.0.smithi052.stdout:process_12_[94071]: shutting down. 2024-09-11T14:50:52.240 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.240 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: starting. 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: creating pool ceph_test_rados_list_parallel.smithi052-93929 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: created object 0... 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: created object 25... 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: created object 49... 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: finishing. 2024-09-11T14:50:52.241 INFO:tasks.workunit.client.0.smithi052.stdout:process_14_[94153]: shutting down. 2024-09-11T14:50:52.820 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.820 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.820 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: starting. 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listing objects. 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listed object 0... 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listed object 25... 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listed object 50... 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listed object 75... 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listed object 100... 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: listed object 125... 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: saw 150 objects 2024-09-11T14:50:52.821 INFO:tasks.workunit.client.0.smithi052.stdout:process_15_[94154]: shutting down. 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:process_16_[94155]: starting. 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:process_16_[94155]: added 25 objects... 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:process_16_[94155]: added half of the objects 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:process_16_[94155]: added 50 objects... 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:process_16_[94155]: added 50 objects 2024-09-11T14:50:53.336 INFO:tasks.workunit.client.0.smithi052.stdout:process_16_[94155]: shutting down. 2024-09-11T14:50:53.599 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.599 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.599 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.599 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.599 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:50:53.599 INFO:tasks.workunit.client.0.smithi052.stdout:******* SUCCESS ********** 2024-09-11T14:50:53.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:50:53.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:50:53.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: starting. 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: creating pool ceph_test_rados_open_pools_parallel.smithi052-94220 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: created object 0... 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: created object 25... 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: created object 49... 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: finishing. 2024-09-11T14:50:57.316 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94221]: shutting down. 2024-09-11T14:50:57.613 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94222]: starting. 2024-09-11T14:50:57.613 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94222]: rados_pool_create. 2024-09-11T14:50:57.613 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94222]: rados_ioctx_create. 2024-09-11T14:50:57.613 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94222]: shutting down. 2024-09-11T14:51:01.259 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:01.259 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: starting. 2024-09-11T14:51:01.259 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: creating pool ceph_test_rados_open_pools_parallel.smithi052-94220 2024-09-11T14:51:01.259 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: created object 0... 2024-09-11T14:51:01.259 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: created object 25... 2024-09-11T14:51:01.259 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: created object 49... 2024-09-11T14:51:01.260 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: finishing. 2024-09-11T14:51:01.260 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94257]: shutting down. 2024-09-11T14:51:01.628 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:01.628 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94258]: starting. 2024-09-11T14:51:01.628 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94258]: rados_pool_create. 2024-09-11T14:51:01.628 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94258]: rados_ioctx_create. 2024-09-11T14:51:01.628 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94258]: shutting down. 2024-09-11T14:51:01.630 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:01.630 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:01.630 INFO:tasks.workunit.client.0.smithi052.stdout:******* SUCCESS ********** 2024-09-11T14:51:01.630 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:51:01.631 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:51:01.631 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: starting. 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: creating pool ceph_test_rados_delete_pools_parallel.smithi052-94293 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: created object 0... 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: created object 25... 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: created object 49... 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: finishing. 2024-09-11T14:51:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:process_1_[94294]: shutting down. 2024-09-11T14:51:05.644 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94295]: starting. 2024-09-11T14:51:05.644 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94295]: deleting pool ceph_test_rados_delete_pools_parallel.smithi052-94293 2024-09-11T14:51:05.644 INFO:tasks.workunit.client.0.smithi052.stdout:process_2_[94295]: shutting down. 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: starting. 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: creating pool ceph_test_rados_delete_pools_parallel.smithi052-94293 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: created object 0... 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: created object 25... 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: created object 49... 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: finishing. 2024-09-11T14:51:09.263 INFO:tasks.workunit.client.0.smithi052.stdout:process_3_[94330]: shutting down. 2024-09-11T14:51:09.441 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:09.442 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[94332]: starting. 2024-09-11T14:51:09.442 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[94332]: listing objects. 2024-09-11T14:51:09.442 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[94332]: listed object 0... 2024-09-11T14:51:09.442 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[94332]: listed object 25... 2024-09-11T14:51:09.442 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[94332]: saw 50 objects 2024-09-11T14:51:09.442 INFO:tasks.workunit.client.0.smithi052.stdout:process_5_[94332]: shutting down. 2024-09-11T14:51:09.656 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:09.656 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94331]: starting. 2024-09-11T14:51:09.656 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94331]: deleting pool ceph_test_rados_delete_pools_parallel.smithi052-94293 2024-09-11T14:51:09.656 INFO:tasks.workunit.client.0.smithi052.stdout:process_4_[94331]: shutting down. 2024-09-11T14:51:09.657 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:09.657 INFO:tasks.workunit.client.0.smithi052.stdout:******************************* 2024-09-11T14:51:09.657 INFO:tasks.workunit.client.0.smithi052.stdout:******* SUCCESS ********** 2024-09-11T14:51:09.658 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:51:09.658 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:51:09.658 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:51:09.659 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' cls = ec_io ']' 2024-09-11T14:51:09.659 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' cls = ec_list ']' 2024-09-11T14:51:09.659 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_cls 2024-09-11T14:51:09.677 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:51:09.677 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:51:09.677 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:51:09.678 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from NeoRadosCls 2024-09-11T14:51:09.678 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-11T14:51:12.666 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosCls.DNE (2988 ms) 2024-09-11T14:51:12.666 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from NeoRadosCls (2988 ms total) 2024-09-11T14:51:12.666 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:51:12.666 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:51:12.666 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 1 test from 1 test suite ran. (2988 ms total) 2024-09-11T14:51:12.666 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 1 test. 2024-09-11T14:51:12.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:51:12.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:51:12.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:51:12.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' cmd = ec_io ']' 2024-09-11T14:51:12.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' cmd = ec_list ']' 2024-09-11T14:51:12.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_cmd 2024-09-11T14:51:12.688 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:51:12.688 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:51:12.688 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:51:12.688 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-11T14:51:12.688 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-11T14:51:14.673 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosCmd.MonDescribe (1985 ms) 2024-09-11T14:51:14.673 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-11T14:51:16.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosCmd.OSDCmd (1930 ms) 2024-09-11T14:51:16.604 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-11T14:51:19.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosCmd.PGCmd (3008 ms) 2024-09-11T14:51:19.612 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from NeoRadosCmd (6923 ms total) 2024-09-11T14:51:19.612 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:51:19.612 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:51:19.612 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 3 tests from 1 test suite ran. (6923 ms total) 2024-09-11T14:51:19.612 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 3 tests. 2024-09-11T14:51:19.614 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:51:19.614 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:51:19.614 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:51:19.614 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' handler_error = ec_io ']' 2024-09-11T14:51:19.614 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' handler_error = ec_list ']' 2024-09-11T14:51:19.614 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_handler_error 2024-09-11T14:51:19.633 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:51:19.633 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:51:19.633 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:51:19.633 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from neocls_handler_error 2024-09-11T14:51:19.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-11T14:51:22.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] neocls_handler_error.test_handler_error (2990 ms) 2024-09-11T14:51:22.623 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 1 test from neocls_handler_error (2990 ms total) 2024-09-11T14:51:22.623 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:51:22.623 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:51:22.623 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 1 test from 1 test suite ran. (2990 ms total) 2024-09-11T14:51:22.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 1 test. 2024-09-11T14:51:22.625 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:51:22.626 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:51:22.626 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:51:22.626 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' io = ec_io ']' 2024-09-11T14:51:22.626 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' io = ec_list ']' 2024-09-11T14:51:22.626 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_io 2024-09-11T14:51:22.648 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:51:22.648 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-11T14:51:22.648 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:51:22.648 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from NeoRadosIo 2024-09-11T14:51:22.648 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-11T14:51:23.630 INFO:tasks.workunit.client.0.smithi052.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:51:24.634 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.Limits (1987 ms) 2024-09-11T14:51:24.635 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-11T14:51:27.643 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.SimpleWrite (3008 ms) 2024-09-11T14:51:27.643 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-11T14:51:30.657 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.ReadOp (3015 ms) 2024-09-11T14:51:30.658 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-11T14:51:33.668 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.SparseRead (3011 ms) 2024-09-11T14:51:33.669 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-11T14:51:36.606 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.RoundTrip (2938 ms) 2024-09-11T14:51:36.607 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-11T14:51:39.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3010 ms) 2024-09-11T14:51:39.617 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-11T14:51:42.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3016 ms) 2024-09-11T14:51:42.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-11T14:51:45.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3013 ms) 2024-09-11T14:51:45.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-11T14:51:48.652 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3007 ms) 2024-09-11T14:51:48.653 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-11T14:51:51.668 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.Trunc (3016 ms) 2024-09-11T14:51:51.668 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-11T14:51:54.682 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.Remove (3013 ms) 2024-09-11T14:51:54.682 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-11T14:51:57.691 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3010 ms) 2024-09-11T14:51:57.691 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-11T14:52:00.699 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.RmXattr (3008 ms) 2024-09-11T14:52:00.699 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-11T14:52:03.717 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosIo.GetXattrs (3017 ms) 2024-09-11T14:52:03.717 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from NeoRadosIo (41069 ms total) 2024-09-11T14:52:03.717 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:52:03.718 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:52:03.718 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 14 tests from 1 test suite ran. (41069 ms total) 2024-09-11T14:52:03.718 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 14 tests. 2024-09-11T14:52:03.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:52:03.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:52:03.723 INFO:tasks.workunit.client.0.smithi052.stdout:Skipping EC with Crimson 2024-09-11T14:52:03.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' ec_io = ec_io ']' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'Skipping EC with Crimson' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ continue 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' list = ec_io ']' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' list = ec_list ']' 2024-09-11T14:52:03.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_list 2024-09-11T14:52:03.744 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:52:03.744 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:52:03.744 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:52:03.744 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from NeoradosList 2024-09-11T14:52:03.744 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-11T14:52:06.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoradosList.ListObjects (2868 ms) 2024-09-11T14:52:06.611 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-11T14:52:10.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoradosList.ListObjectsNS (4016 ms) 2024-09-11T14:52:10.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-11T14:52:24.621 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoradosList.ListObjectsMany (13994 ms) 2024-09-11T14:52:24.621 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 3 tests from NeoradosList (20878 ms total) 2024-09-11T14:52:24.622 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:52:24.622 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:52:24.622 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 3 tests from 1 test suite ran. (20878 ms total) 2024-09-11T14:52:24.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 3 tests. 2024-09-11T14:52:24.623 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:52:24.623 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stdout:Skipping EC with Crimson 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' ec_list = ec_io ']' 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' ec_list = ec_list ']' 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'Skipping EC with Crimson' 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ continue 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:52:24.624 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:52:24.625 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:52:24.625 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' misc = ec_io ']' 2024-09-11T14:52:24.625 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' misc = ec_list ']' 2024-09-11T14:52:24.625 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_misc 2024-09-11T14:52:24.644 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:52:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-11T14:52:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:52:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-11T14:52:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-11T14:52:26.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.Version (1988 ms) 2024-09-11T14:52:26.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-11T14:52:28.640 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2008 ms) 2024-09-11T14:52:28.641 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-11T14:52:31.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.LongName (2974 ms) 2024-09-11T14:52:31.615 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-11T14:52:32.616 INFO:tasks.workunit.client.0.smithi052.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:52:33.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.LongLocator (2003 ms) 2024-09-11T14:52:33.618 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-11T14:52:36.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.LongNamespace (3016 ms) 2024-09-11T14:52:36.633 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-11T14:52:39.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.LongAttrName (3011 ms) 2024-09-11T14:52:39.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-11T14:52:42.657 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.Exec (3013 ms) 2024-09-11T14:52:42.657 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-11T14:52:45.670 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.Operate1 (3013 ms) 2024-09-11T14:52:45.670 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-11T14:52:48.680 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.Operate2 (3009 ms) 2024-09-11T14:52:48.680 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-11T14:52:51.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.BigObject (2943 ms) 2024-09-11T14:52:51.622 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-11T14:52:53.628 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.BigAttr (2006 ms) 2024-09-11T14:52:53.629 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-11T14:52:54.632 INFO:tasks.workunit.client.0.smithi052.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:52:55.637 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosMisc.WriteSame (2008 ms) 2024-09-11T14:52:55.637 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 12 tests from NeoRadosMisc (30992 ms total) 2024-09-11T14:52:55.637 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:52:55.637 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:52:55.637 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 12 tests from 1 test suite ran. (30992 ms total) 2024-09-11T14:52:55.637 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 12 tests. 2024-09-11T14:52:55.642 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:52:55.642 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:52:55.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:52:55.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' pool = ec_io ']' 2024-09-11T14:52:55.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' pool = ec_list ']' 2024-09-11T14:52:55.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_pool 2024-09-11T14:52:55.665 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:52:55.665 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-11T14:52:55.665 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:52:55.665 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 6 tests from NeoRadosPools 2024-09-11T14:52:55.665 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-11T14:52:57.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosPools.PoolList (1980 ms) 2024-09-11T14:52:57.645 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-11T14:52:59.655 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosPools.PoolLookup (2011 ms) 2024-09-11T14:52:59.655 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-11T14:53:01.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (1968 ms) 2024-09-11T14:53:01.623 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-11T14:53:05.678 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosPools.PoolDelete (4055 ms) 2024-09-11T14:53:05.678 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-11T14:53:07.687 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2009 ms) 2024-09-11T14:53:07.687 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-11T14:53:09.698 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2010 ms) 2024-09-11T14:53:09.698 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 6 tests from NeoRadosPools (14033 ms total) 2024-09-11T14:53:09.698 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:53:09.698 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:53:09.698 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 6 tests from 1 test suite ran. (14033 ms total) 2024-09-11T14:53:09.698 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 6 tests. 2024-09-11T14:53:09.701 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:53:09.701 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:53:09.702 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:53:09.702 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' read_operations = ec_io ']' 2024-09-11T14:53:09.702 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' read_operations = ec_list ']' 2024-09-11T14:53:09.702 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_read_operations 2024-09-11T14:53:09.725 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:53:09.725 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-11T14:53:09.725 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:53:09.725 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-11T14:53:09.725 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-11T14:53:12.707 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2983 ms) 2024-09-11T14:53:12.707 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-11T14:53:15.721 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.AssertExists (3013 ms) 2024-09-11T14:53:15.721 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-11T14:53:18.730 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3009 ms) 2024-09-11T14:53:18.730 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-11T14:53:21.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.CmpXattr (2902 ms) 2024-09-11T14:53:21.632 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-11T14:53:24.642 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.Read (3010 ms) 2024-09-11T14:53:24.642 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-11T14:53:27.657 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.Checksum (3015 ms) 2024-09-11T14:53:27.657 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-11T14:53:30.666 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3010 ms) 2024-09-11T14:53:30.666 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-11T14:53:33.678 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.ShortRead (3012 ms) 2024-09-11T14:53:33.679 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-11T14:53:36.688 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.Exec (3009 ms) 2024-09-11T14:53:36.688 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-11T14:53:39.704 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.Stat (3017 ms) 2024-09-11T14:53:39.704 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-11T14:53:42.713 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.Omap (3008 ms) 2024-09-11T14:53:42.713 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-11T14:53:45.726 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3014 ms) 2024-09-11T14:53:45.726 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-11T14:53:48.740 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3013 ms) 2024-09-11T14:53:48.740 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-11T14:53:51.638 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosReadOps.CmpExt (2899 ms) 2024-09-11T14:53:51.638 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 14 tests from NeoRadosReadOps (41914 ms total) 2024-09-11T14:53:51.638 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:53:51.638 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:53:51.638 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 14 tests from 1 test suite ran. (41914 ms total) 2024-09-11T14:53:51.639 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 14 tests. 2024-09-11T14:53:51.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:53:51.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:53:51.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:53:51.643 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' snapshots = ec_io ']' 2024-09-11T14:53:51.644 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' snapshots = ec_list ']' 2024-09-11T14:53:51.644 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_snapshots 2024-09-11T14:53:51.664 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:53:51.665 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-11T14:53:51.665 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:53:51.665 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-11T14:53:51.665 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-11T14:53:56.658 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSnapshots.SnapList (4994 ms) 2024-09-11T14:53:56.659 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-11T14:54:01.638 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4980 ms) 2024-09-11T14:54:01.639 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-11T14:54:05.652 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSnapshots.Rollback (4014 ms) 2024-09-11T14:54:05.652 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-11T14:54:10.672 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5019 ms) 2024-09-11T14:54:10.672 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-11T14:54:17.705 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7033 ms) 2024-09-11T14:54:17.705 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 5 tests from NeoRadosSnapshots (26040 ms total) 2024-09-11T14:54:17.705 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:54:17.705 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-11T14:54:17.705 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-11T14:54:22.722 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5018 ms) 2024-09-11T14:54:22.723 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-11T14:54:23.726 INFO:tasks.workunit.client.0.smithi052.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:54:24.728 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2006 ms) 2024-09-11T14:54:24.728 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-11T14:54:25.737 INFO:tasks.workunit.client.0.smithi052.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:54:26.743 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2015 ms) 2024-09-11T14:54:26.743 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-11T14:54:32.651 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5907 ms) 2024-09-11T14:54:32.651 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-11T14:54:36.667 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4017 ms) 2024-09-11T14:54:36.668 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-11T14:54:39.682 INFO:tasks.workunit.client.0.smithi052.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi052-95228-11. 2024-09-11T14:54:40.686 INFO:tasks.workunit.client.0.smithi052.stdout:Waiting for snaps to purge. 2024-09-11T14:54:56.199 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19532 ms) 2024-09-11T14:54:56.199 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38495 ms total) 2024-09-11T14:54:56.200 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:54:56.200 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:54:56.200 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 11 tests from 2 test suites ran. (64535 ms total) 2024-09-11T14:54:56.200 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 11 tests. 2024-09-11T14:54:56.203 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:54:56.203 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:54:56.203 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:54:56.203 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' watch_notify = ec_io ']' 2024-09-11T14:54:56.203 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' watch_notify = ec_list ']' 2024-09-11T14:54:56.203 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_watch_notify 2024-09-11T14:54:56.226 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:54:56.226 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-11T14:54:56.226 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:54:56.226 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-11T14:54:56.226 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-11T14:54:58.097 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 16919952 notify_id 2881923055618 notifier_gid 15899 2024-09-11T14:54:58.663 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2438 ms) 2024-09-11T14:54:58.664 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-11T14:55:00.989 INFO:tasks.workunit.client.0.smithi052.stdout:Trying... 2024-09-11T14:55:00.994 INFO:tasks.workunit.client.0.smithi052.stdout:handle_notify cookie 30398640 notify_id 2894807957509 notifier_gid 15902 2024-09-11T14:55:00.994 INFO:tasks.workunit.client.0.smithi052.stdout:Waiting for 3.000000000s 2024-09-11T14:55:01.991 INFO:tasks.workunit.client.0.smithi052.stdout:Timed out. 2024-09-11T14:55:02.008 INFO:tasks.workunit.client.0.smithi052.stdout:Flushing... 2024-09-11T14:55:02.008 INFO:tasks.workunit.client.0.smithi052.stdout:Flushed... 2024-09-11T14:55:05.064 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6401 ms) 2024-09-11T14:55:05.065 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 2 tests from NeoRadosWatchNotify (8839 ms total) 2024-09-11T14:55:05.065 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:55:05.065 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:55:05.065 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 2 tests from 1 test suite ran. (8839 ms total) 2024-09-11T14:55:05.065 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 2 tests. 2024-09-11T14:55:05.067 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:55:05.067 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:55:05.067 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:55:05.067 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' write_operations = ec_io ']' 2024-09-11T14:55:05.067 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' write_operations = ec_list ']' 2024-09-11T14:55:05.067 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_neorados_write_operations 2024-09-11T14:55:05.090 INFO:tasks.workunit.client.0.smithi052.stdout:Running main() from gmock_main.cc 2024-09-11T14:55:05.090 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:55:05.090 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment set-up. 2024-09-11T14:55:05.090 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-11T14:55:05.090 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-11T14:55:07.658 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2567 ms) 2024-09-11T14:55:07.658 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-11T14:55:10.669 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3012 ms) 2024-09-11T14:55:10.669 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-11T14:55:13.681 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3012 ms) 2024-09-11T14:55:13.682 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-11T14:55:16.661 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.Write (2980 ms) 2024-09-11T14:55:16.662 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-11T14:55:19.707 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.Exec (3045 ms) 2024-09-11T14:55:19.707 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-11T14:55:22.718 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3011 ms) 2024-09-11T14:55:22.729 INFO:tasks.workunit.client.0.smithi052.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-11T14:55:37.665 INFO:tasks.workunit.client.0.smithi052.stdout:[ OK ] NeoRadosWriteOps.CmpExt (14948 ms) 2024-09-11T14:55:37.665 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] 7 tests from NeoRadosWriteOps (32575 ms total) 2024-09-11T14:55:37.666 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-09-11T14:55:37.666 INFO:tasks.workunit.client.0.smithi052.stdout:[----------] Global test environment tear-down 2024-09-11T14:55:37.666 INFO:tasks.workunit.client.0.smithi052.stdout:[==========] 7 tests from 1 test suite ran. (32575 ms total) 2024-09-11T14:55:37.666 INFO:tasks.workunit.client.0.smithi052.stdout:[ PASSED ] 7 tests. 2024-09-11T14:55:37.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ ret=0 2024-09-11T14:55:37.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:55:37.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ exit 0 2024-09-11T14:55:37.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ cleanup 2024-09-11T14:55:37.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ pkill -P 29629 2024-09-11T14:55:37.687 INFO:tasks.workunit.client.0.smithi052.stderr:+ true 2024-09-11T14:55:37.687 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:55:37.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:55:37.775 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-11T14:55:37.777 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-11T14:55:37.777 DEBUG:teuthology.orchestra.run.smithi052:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dbebf1a3db6db7b5579464ee715edcf1b3e9cce2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-11T14:55:37.801 INFO:tasks.workunit.client.0.smithi052.stderr:++ uuidgen 2024-09-11T14:55:37.810 INFO:tasks.workunit.client.0.smithi052.stderr:+ p=44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:55:37.810 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool create 44c281f7-10ec-4da5-9213-49ec274d2684 12 2024-09-11T14:55:37.918 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.907+0000 7f91132a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:37.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.918+0000 7f91132a3640 1 Processor -- start 2024-09-11T14:55:37.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.919+0000 7f91132a3640 1 -- start start 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f91132a3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f910c139000 0x7f910c13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f91132a3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c135c90 con 0x7f910c136050 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f91132a3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f910c0a15a0 con 0x7f910c139000 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f911083e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f910c139000 0x7f910c13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f911083e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f910c139000 0x7f910c13b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49012/0 (socket says 172.21.15.52:49012) 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f911083e640 1 -- 172.21.15.52:0/2088061786 learned_addr learned my addr 172.21.15.52:0/2088061786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f911103f640 1 --1- 172.21.15.52:0/2088061786 >> v1:172.21.15.52:6789/0 conn(0x7f910c136050 0x7f910c136460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37918/0 (socket says 172.21.15.52:37918) 2024-09-11T14:55:37.923 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f911083e640 1 -- 172.21.15.52:0/2088061786 >> v1:172.21.15.52:6789/0 conn(0x7f910c136050 legacy=0x7f910c136460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:37.924 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f911083e640 1 -- 172.21.15.52:0/2088061786 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0a0d70 con 0x7f910c139000 2024-09-11T14:55:37.924 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.921+0000 7f9103fff640 1 -- 172.21.15.52:0/2088061786 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573433688 0 0) 0x7f910c135c90 con 0x7f910c136050 2024-09-11T14:55:37.924 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.922+0000 7f911083e640 1 --2- 172.21.15.52:0/2088061786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c139000 0x7f910c13b420 crc :-1 s=READY pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10130726e229586a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:37.924 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.922+0000 7f9103fff640 1 -- 172.21.15.52:0/2088061786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90fc009e50 con 0x7f910c139000 2024-09-11T14:55:37.924 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.922+0000 7f9103fff640 1 -- 172.21.15.52:0/2088061786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f90fc00e230 con 0x7f910c139000 2024-09-11T14:55:37.924 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.922+0000 7f9103fff640 1 -- 172.21.15.52:0/2088061786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90fc00e4d0 con 0x7f910c139000 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 -- 172.21.15.52:0/2088061786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c139000 msgr2=0x7f910c13b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 --2- 172.21.15.52:0/2088061786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c139000 0x7f910c13b420 crc :-1 s=READY pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 -- 172.21.15.52:0/2088061786 shutdown_connections 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 --2- 172.21.15.52:0/2088061786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c139000 0x7f910c13b420 unknown :-1 s=CLOSED pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 -- 172.21.15.52:0/2088061786 >> 172.21.15.52:0/2088061786 conn(0x7f910c0a6200 msgr2=0x7f910c0a6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 -- 172.21.15.52:0/2088061786 shutdown_connections 2024-09-11T14:55:37.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 1 -- 172.21.15.52:0/2088061786 wait complete. 2024-09-11T14:55:37.926 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.923+0000 7f91132a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:37.926 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.925+0000 7f91132a3640 1 Processor -- start 2024-09-11T14:55:37.927 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.926+0000 7f91132a3640 1 -- start start 2024-09-11T14:55:37.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.928+0000 7f91132a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 0x7f910c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:37.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.928+0000 7f91132a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f910c12fe30 con 0x7f910c136050 2024-09-11T14:55:37.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.928+0000 7f911103f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 0x7f910c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:37.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.928+0000 7f911103f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 0x7f910c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49028/0 (socket says 172.21.15.52:49028) 2024-09-11T14:55:37.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.928+0000 7f911103f640 1 -- 172.21.15.52:0/2806440197 learned_addr learned my addr 172.21.15.52:0/2806440197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:37.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.929+0000 7f911103f640 1 -- 172.21.15.52:0/2806440197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c133180 con 0x7f910c136050 2024-09-11T14:55:37.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.929+0000 7f911103f640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 0x7f910c1304b0 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:37.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.929+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9108004b80 con 0x7f910c136050 2024-09-11T14:55:37.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.929+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9108004ce0 con 0x7f910c136050 2024-09-11T14:55:37.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.929+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c12fb90 con 0x7f910c136050 2024-09-11T14:55:37.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.929+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9108007120 con 0x7f910c136050 2024-09-11T14:55:37.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.930+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c12f620 con 0x7f910c136050 2024-09-11T14:55:37.932 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.931+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9108007320 con 0x7f910c136050 2024-09-11T14:55:37.932 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.931+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c0a26f0 con 0x7f910c136050 2024-09-11T14:55:37.932 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.931+0000 7f9101ffb640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f90f003e8e0 0x7f90f0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:37.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.931+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(700..700 src has 412..700) ==== 3431+0+0 (crc 0 0 0) 0x7f910804fa70 con 0x7f910c136050 2024-09-11T14:55:37.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.932+0000 7f911083e640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f90f003e8e0 0x7f90f0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:37.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.932+0000 7f911083e640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f90f003e8e0 0x7f90f0040df0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:37.938 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:37.937+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f910800f230 con 0x7f910c136050 2024-09-11T14:55:38.156 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.154+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pg_num": 12} v 0) -- 0x7f910c1311c0 con 0x7f910c136050 2024-09-11T14:55:38.664 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.663+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pg_num": 12}]=0 pool '44c281f7-10ec-4da5-9213-49ec274d2684' created v701) ==== 176+0+0 (crc 0 0 0) 0x7f910800a0c0 con 0x7f910c136050 2024-09-11T14:55:38.794 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.792+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pg_num": 12} v 0) -- 0x7f910c0008d0 con 0x7f910c136050 2024-09-11T14:55:38.794 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.793+0000 7f9101ffb640 1 -- 172.21.15.52:0/2806440197 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pg_num": 12}]=0 pool '44c281f7-10ec-4da5-9213-49ec274d2684' already exists v701) ==== 183+0+0 (crc 0 0 0) 0x7f910800a7b0 con 0x7f910c136050 2024-09-11T14:55:38.794 INFO:tasks.workunit.client.0.smithi052.stderr:pool '44c281f7-10ec-4da5-9213-49ec274d2684' already exists 2024-09-11T14:55:38.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f90f003e8e0 msgr2=0x7f90f0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:38.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f90f003e8e0 0x7f90f0040df0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:38.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 msgr2=0x7f910c1304b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:38.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 0x7f910c1304b0 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:38.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 shutdown_connections 2024-09-11T14:55:38.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f90f003e8e0 0x7f90f0040df0 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:38.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 --2- 172.21.15.52:0/2806440197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c136050 0x7f910c1304b0 unknown :-1 s=CLOSED pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:38.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 >> 172.21.15.52:0/2806440197 conn(0x7f910c0a6200 msgr2=0x7f910c136de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:38.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 shutdown_connections 2024-09-11T14:55:38.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.796+0000 7f91132a3640 1 -- 172.21.15.52:0/2806440197 wait complete. 2024-09-11T14:55:38.807 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_objects 10 2024-09-11T14:55:38.904 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.894+0000 7f6f4b4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:38.906 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.904+0000 7f6f4b4bd640 1 Processor -- start 2024-09-11T14:55:38.906 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.905+0000 7f6f4b4bd640 1 -- start start 2024-09-11T14:55:38.908 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f4b4bd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f44136fe0 0x7f6f4413b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:38.908 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f4b4bd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f440a16a0 con 0x7f6f441364c0 2024-09-11T14:55:38.908 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f4b4bd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6f440a0a00 con 0x7f6f44136fe0 2024-09-11T14:55:38.908 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f48a58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f44136fe0 0x7f6f4413b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f49259640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6f441364c0 0x7f6f441368d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37934/0 (socket says 172.21.15.52:37934) 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f48a58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f44136fe0 0x7f6f4413b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49038/0 (socket says 172.21.15.52:49038) 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.906+0000 7f6f49259640 1 -- 172.21.15.52:0/2698075428 learned_addr learned my addr 172.21.15.52:0/2698075428 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f48a58640 1 -- 172.21.15.52:0/2698075428 >> v1:172.21.15.52:6789/0 conn(0x7f6f441364c0 legacy=0x7f6f441368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f3bfff640 1 -- 172.21.15.52:0/2698075428 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372264875 0 0) 0x7f6f440a16a0 con 0x7f6f441364c0 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f48a58640 1 -- 172.21.15.52:0/2698075428 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f440a13b0 con 0x7f6f44136fe0 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f48a58640 1 --2- 172.21.15.52:0/2698075428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f44136fe0 0x7f6f4413b700 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0764f262cb6a8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f3bfff640 1 -- 172.21.15.52:0/2698075428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f34009d90 con 0x7f6f44136fe0 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f3bfff640 1 -- 172.21.15.52:0/2698075428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f3400e230 con 0x7f6f44136fe0 2024-09-11T14:55:38.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.907+0000 7f6f3bfff640 1 -- 172.21.15.52:0/2698075428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f3400e4d0 con 0x7f6f44136fe0 2024-09-11T14:55:38.910 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/2698075428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f44136fe0 msgr2=0x7f6f4413b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:38.910 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 --2- 172.21.15.52:0/2698075428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f44136fe0 0x7f6f4413b700 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:38.910 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/2698075428 shutdown_connections 2024-09-11T14:55:38.910 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 --2- 172.21.15.52:0/2698075428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f44136fe0 0x7f6f4413b700 unknown :-1 s=CLOSED pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:38.910 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/2698075428 >> 172.21.15.52:0/2698075428 conn(0x7f6f440a6270 msgr2=0x7f6f440a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:38.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/2698075428 shutdown_connections 2024-09-11T14:55:38.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/2698075428 wait complete. 2024-09-11T14:55:38.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.908+0000 7f6f4b4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:38.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.910+0000 7f6f4b4bd640 1 Processor -- start 2024-09-11T14:55:38.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.911+0000 7f6f4b4bd640 1 -- start start 2024-09-11T14:55:38.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.912+0000 7f6f4b4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 0x7f6f4409e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:38.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.912+0000 7f6f4b4bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f44133be0 con 0x7f6f441364c0 2024-09-11T14:55:38.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.912+0000 7f6f49259640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 0x7f6f4409e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:38.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.912+0000 7f6f49259640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 0x7f6f4409e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49048/0 (socket says 172.21.15.52:49048) 2024-09-11T14:55:38.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.912+0000 7f6f49259640 1 -- 172.21.15.52:0/1747248990 learned_addr learned my addr 172.21.15.52:0/1747248990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:38.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f49259640 1 -- 172.21.15.52:0/1747248990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f44136120 con 0x7f6f441364c0 2024-09-11T14:55:38.915 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f49259640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 0x7f6f4409e850 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:38.915 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f40004b80 con 0x7f6f441364c0 2024-09-11T14:55:38.915 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f40004ce0 con 0x7f6f441364c0 2024-09-11T14:55:38.915 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f40007120 con 0x7f6f441364c0 2024-09-11T14:55:38.915 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f44132430 con 0x7f6f441364c0 2024-09-11T14:55:38.915 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.913+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f440a42e0 con 0x7f6f441364c0 2024-09-11T14:55:38.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.914+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f440a2230 con 0x7f6f441364c0 2024-09-11T14:55:38.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.914+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6f400072d0 con 0x7f6f441364c0 2024-09-11T14:55:38.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.915+0000 7f6f39ffb640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6f2803e930 0x7f6f28040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:38.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.915+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(701..701 src has 412..701) ==== 3806+0+0 (crc 0 0 0) 0x7f6f4004fb80 con 0x7f6f441364c0 2024-09-11T14:55:38.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.915+0000 7f6f48a58640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6f2803e930 0x7f6f28040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:38.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.915+0000 7f6f48a58640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6f2803e930 0x7f6f28040e40 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:38.921 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:38.920+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6f4000f230 con 0x7f6f441364c0 2024-09-11T14:55:39.110 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:39.108+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "10"} v 0) -- 0x7f6f44050fc0 con 0x7f6f441364c0 2024-09-11T14:55:39.667 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:39.666+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v702) ==== 223+0+0 (crc 0 0 0) 0x7f6f4000a0c0 con 0x7f6f441364c0 2024-09-11T14:55:39.833 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:39.832+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "10"} v 0) -- 0x7f6f44074a10 con 0x7f6f441364c0 2024-09-11T14:55:40.672 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.670+0000 7f6f39ffb640 1 -- 172.21.15.52:0/1747248990 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v703) ==== 223+0+0 (crc 0 0 0) 0x7f6f4000a7b0 con 0x7f6f441364c0 2024-09-11T14:55:40.672 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_objects = 10 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:55:40.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6f2803e930 msgr2=0x7f6f28040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:40.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6f2803e930 0x7f6f28040e40 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:40.678 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 msgr2=0x7f6f4409e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:40.678 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 0x7f6f4409e850 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:40.678 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 shutdown_connections 2024-09-11T14:55:40.678 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6f2803e930 0x7f6f28040e40 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:40.678 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 --2- 172.21.15.52:0/1747248990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f441364c0 0x7f6f4409e850 unknown :-1 s=CLOSED pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:40.678 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 >> 172.21.15.52:0/1747248990 conn(0x7f6f440a6270 msgr2=0x7f6f440714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:40.679 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 shutdown_connections 2024-09-11T14:55:40.679 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.675+0000 7f6f4b4bd640 1 -- 172.21.15.52:0/1747248990 wait complete. 2024-09-11T14:55:40.694 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool application enable 44c281f7-10ec-4da5-9213-49ec274d2684 rados 2024-09-11T14:55:40.805 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.795+0000 7fbd48911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:40.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.805+0000 7fbd48911640 1 Processor -- start 2024-09-11T14:55:40.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.805+0000 7fbd48911640 1 -- start start 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.807+0000 7fbd48911640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd44136da0 0x7fbd441391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.807+0000 7fbd48911640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44131460 con 0x7fbd44130940 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.807+0000 7fbd48911640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbd4409d000 con 0x7fbd44136da0 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.807+0000 7fbd4259c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbd44130940 0x7fbd44130d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37944/0 (socket says 172.21.15.52:37944) 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.807+0000 7fbd41d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd44136da0 0x7fbd441391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.807+0000 7fbd4259c640 1 -- 172.21.15.52:0/3769194240 learned_addr learned my addr 172.21.15.52:0/3769194240 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.808+0000 7fbd41d9b640 1 -- 172.21.15.52:0/3769194240 >> v1:172.21.15.52:6789/0 conn(0x7fbd44130940 legacy=0x7fbd44130d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.808+0000 7fbd41d9b640 1 -- 172.21.15.52:0/3769194240 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4409d990 con 0x7fbd44136da0 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.808+0000 7fbd41d9b640 1 --2- 172.21.15.52:0/3769194240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44136da0 0x7fbd441391c0 crc :-1 s=READY pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10656606a0b1c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.808+0000 7fbd4159a640 1 -- 172.21.15.52:0/3769194240 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd38009d90 con 0x7fbd44136da0 2024-09-11T14:55:40.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.808+0000 7fbd4159a640 1 -- 172.21.15.52:0/3769194240 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd3800e230 con 0x7fbd44136da0 2024-09-11T14:55:40.810 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.808+0000 7fbd4159a640 1 -- 172.21.15.52:0/3769194240 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd3800e4d0 con 0x7fbd44136da0 2024-09-11T14:55:40.810 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 -- 172.21.15.52:0/3769194240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44136da0 msgr2=0x7fbd441391c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:40.810 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 --2- 172.21.15.52:0/3769194240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44136da0 0x7fbd441391c0 crc :-1 s=READY pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:40.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 -- 172.21.15.52:0/3769194240 shutdown_connections 2024-09-11T14:55:40.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 --2- 172.21.15.52:0/3769194240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44136da0 0x7fbd441391c0 unknown :-1 s=CLOSED pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:40.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 -- 172.21.15.52:0/3769194240 >> 172.21.15.52:0/3769194240 conn(0x7fbd440a0f60 msgr2=0x7fbd440a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:40.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 -- 172.21.15.52:0/3769194240 shutdown_connections 2024-09-11T14:55:40.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 1 -- 172.21.15.52:0/3769194240 wait complete. 2024-09-11T14:55:40.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.809+0000 7fbd48911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:40.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.811+0000 7fbd48911640 1 Processor -- start 2024-09-11T14:55:40.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.811+0000 7fbd48911640 1 -- start start 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd48911640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 0x7fbd44128fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd48911640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440744a0 con 0x7fbd44130940 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 0x7fbd44128fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 0x7fbd44128fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49060/0 (socket says 172.21.15.52:49060) 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd4259c640 1 -- 172.21.15.52:0/3954862034 learned_addr learned my addr 172.21.15.52:0/3954862034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd4259c640 1 -- 172.21.15.52:0/3954862034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd44073cd0 con 0x7fbd44130940 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd4259c640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 0x7fbd44128fb0 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd34005a60 con 0x7fbd44130940 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd34005bc0 con 0x7fbd44130940 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4412a030 con 0x7fbd44130940 2024-09-11T14:55:40.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd34005e60 con 0x7fbd44130940 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.813+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4412a710 con 0x7fbd44130940 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.814+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbd340070b0 con 0x7fbd44130940 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.814+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd441300e0 con 0x7fbd44130940 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.815+0000 7fbd32ffd640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbd2403e930 0x7fbd24040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.815+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(703..703 src has 412..703) ==== 3806+0+0 (crc 0 0 0) 0x7fbd3404f990 con 0x7fbd44130940 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.815+0000 7fbd41d9b640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbd2403e930 0x7fbd24040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:40.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.816+0000 7fbd41d9b640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbd2403e930 0x7fbd24040e40 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:40.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:40.820+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbd441300e0 con 0x7fbd44130940 2024-09-11T14:55:41.009 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:41.007+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "app": "rados"} v 0) -- 0x7fbd44131460 con 0x7fbd44130940 2024-09-11T14:55:41.675 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:41.674+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "app": "rados"}]=0 enabled application 'rados' on pool '44c281f7-10ec-4da5-9213-49ec274d2684' v704) ==== 213+0+0 (crc 0 0 0) 0x7fbd44131460 con 0x7fbd44130940 2024-09-11T14:55:41.827 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:41.826+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "app": "rados"} v 0) -- 0x7fbd44131460 con 0x7fbd44130940 2024-09-11T14:55:42.676 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.675+0000 7fbd32ffd640 1 -- 172.21.15.52:0/3954862034 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "app": "rados"}]=0 enabled application 'rados' on pool '44c281f7-10ec-4da5-9213-49ec274d2684' v705) ==== 213+0+0 (crc 0 0 0) 0x7fbd44131460 con 0x7fbd44130940 2024-09-11T14:55:42.676 INFO:tasks.workunit.client.0.smithi052.stderr:enabled application 'rados' on pool '44c281f7-10ec-4da5-9213-49ec274d2684' 2024-09-11T14:55:42.679 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbd2403e930 msgr2=0x7fbd24040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.679 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbd2403e930 0x7fbd24040e40 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.679 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 msgr2=0x7fbd44128fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.679 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 0x7fbd44128fb0 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 shutdown_connections 2024-09-11T14:55:42.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbd2403e930 0x7fbd24040e40 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 --2- 172.21.15.52:0/3954862034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd44130940 0x7fbd44128fb0 unknown :-1 s=CLOSED pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 >> 172.21.15.52:0/3954862034 conn(0x7fbd440a0f60 msgr2=0x7fbd4412f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 shutdown_connections 2024-09-11T14:55:42.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.678+0000 7fbd48911640 1 -- 172.21.15.52:0/3954862034 wait complete. 2024-09-11T14:55:42.692 INFO:tasks.workunit.client.0.smithi052.stderr:++ seq 1 10 2024-09-11T14:55:42.704 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:42.704 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj1 /etc/passwd 2024-09-11T14:55:42.748 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.747+0000 7f45f96feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.753+0000 7f45f96feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.753+0000 7f45f96feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.754+0000 7f45f96feec0 1 Processor -- start 2024-09-11T14:55:42.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.754+0000 7f45f96feec0 1 -- start start 2024-09-11T14:55:42.757 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f96feec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.757 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f96feec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x2388520 con 0x24b57f0 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f1b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f1b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49082/0 (socket says 172.21.15.52:49082) 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f1b9b640 1 -- 172.21.15.52:0/593432674 learned_addr learned my addr 172.21.15.52:0/593432674 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f1b9b640 1 -- 172.21.15.52:0/593432674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2324e10 con 0x24b57f0 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45f1b9b640 1 --2- 172.21.15.52:0/593432674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a06a0 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd90e5cb31924bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45eb7fe640 1 -- 172.21.15.52:0/593432674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45dc00b580 con 0x24b57f0 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45eb7fe640 1 -- 172.21.15.52:0/593432674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f45dc00b6e0 con 0x24b57f0 2024-09-11T14:55:42.758 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.756+0000 7f45eb7fe640 1 -- 172.21.15.52:0/593432674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45dc00b980 con 0x24b57f0 2024-09-11T14:55:42.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 -- 172.21.15.52:0/593432674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 msgr2=0x24a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 --2- 172.21.15.52:0/593432674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a06a0 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 -- 172.21.15.52:0/593432674 shutdown_connections 2024-09-11T14:55:42.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 --2- 172.21.15.52:0/593432674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a06a0 unknown :-1 s=CLOSED pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 -- 172.21.15.52:0/593432674 >> 172.21.15.52:0/593432674 conn(0x2348770 msgr2=0x241d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.760 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 -- 172.21.15.52:0/593432674 shutdown_connections 2024-09-11T14:55:42.760 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.757+0000 7f45f96feec0 1 -- 172.21.15.52:0/593432674 wait complete. 2024-09-11T14:55:42.760 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.758+0000 7f45f96feec0 1 Processor -- start 2024-09-11T14:55:42.760 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.758+0000 7f45f96feec0 1 -- start start 2024-09-11T14:55:42.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f96feec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f96feec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x2386280 con 0x24b57f0 2024-09-11T14:55:42.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f1b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f1b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49084/0 (socket says 172.21.15.52:49084) 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f1b9b640 1 -- 172.21.15.52:0/2278058186 learned_addr learned my addr 172.21.15.52:0/2278058186 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f1b9b640 1 -- 172.21.15.52:0/2278058186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2316920 con 0x24b57f0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f1b9b640 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a3a10 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45ea7fc640 1 -- 172.21.15.52:0/2278058186 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45dc012960 con 0x24b57f0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45ea7fc640 1 -- 172.21.15.52:0/2278058186 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f45dc005040 con 0x24b57f0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2316380 con 0x24b57f0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45ea7fc640 1 -- 172.21.15.52:0/2278058186 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45dc012bf0 con 0x24b57f0 2024-09-11T14:55:42.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.760+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x24a78b0 con 0x24b57f0 2024-09-11T14:55:42.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.761+0000 7f45ea7fc640 1 -- 172.21.15.52:0/2278058186 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f45dc00d040 con 0x24b57f0 2024-09-11T14:55:42.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.761+0000 7f45ea7fc640 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45d803d1c0 0x7f45d803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.762+0000 7f45ea7fc640 1 -- 172.21.15.52:0/2278058186 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f45dc00a040 con 0x24b57f0 2024-09-11T14:55:42.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.762+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> v2:172.21.15.52:6807/1907008724 conn(0x24b6310 0x294e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.762+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x24a72f0 con 0x24b6310 2024-09-11T14:55:42.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.762+0000 7f45f139a640 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45d803d1c0 0x7f45d803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.762+0000 7f45f139a640 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45d803d1c0 0x7f45d803f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.762+0000 7f45f239c640 1 --2- 172.21.15.52:0/2278058186 >> v2:172.21.15.52:6807/1907008724 conn(0x24b6310 0x294e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:42.767 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.766+0000 7f45f239c640 1 --2- 172.21.15.52:0/2278058186 >> v2:172.21.15.52:6807/1907008724 conn(0x24b6310 0x294e840 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f239c640 1 -- 172.21.15.52:0/2278058186 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj1 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f45e400a430 con 0x24b6310 2024-09-11T14:55:42.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 >> v2:172.21.15.52:6807/1907008724 conn(0x24b6310 msgr2=0x294e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> v2:172.21.15.52:6807/1907008724 conn(0x24b6310 0x294e840 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45d803d1c0 msgr2=0x7f45d803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45d803d1c0 0x7f45d803f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 msgr2=0x24a3a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a3a10 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 shutdown_connections 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> v2:172.21.15.52:6807/1907008724 conn(0x24b6310 0x294e840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f45d803d1c0 0x7f45d803f6d0 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 --2- 172.21.15.52:0/2278058186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x24b57f0 0x24a3a10 unknown :-1 s=CLOSED pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.795+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 >> 172.21.15.52:0/2278058186 conn(0x2348770 msgr2=0x2425f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.796+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 shutdown_connections 2024-09-11T14:55:42.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.796+0000 7f45f96feec0 1 -- 172.21.15.52:0/2278058186 wait complete. 2024-09-11T14:55:42.799 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:42.799 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj2 /etc/passwd 2024-09-11T14:55:42.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.835+0000 7f0231b76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.841+0000 7f0231b76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.841+0000 7f0231b76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.842+0000 7f0231b76ec0 1 Processor -- start 2024-09-11T14:55:42.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.842+0000 7f0231b76ec0 1 -- start start 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.843+0000 7f0231b76ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.843+0000 7f0231b76ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x9b9520 con 0xae67f0 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.843+0000 7f022a59b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.843+0000 7f022a59b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49090/0 (socket says 172.21.15.52:49090) 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.843+0000 7f022a59b640 1 -- 172.21.15.52:0/3134406146 learned_addr learned my addr 172.21.15.52:0/3134406146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f022a59b640 1 -- 172.21.15.52:0/3134406146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x955e10 con 0xae67f0 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f022a59b640 1 --2- 172.21.15.52:0/3134406146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad0690 crc :-1 s=READY pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb1b58831472745 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0228d98640 1 -- 172.21.15.52:0/3134406146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f021400b580 con 0xae67f0 2024-09-11T14:55:42.846 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0228d98640 1 -- 172.21.15.52:0/3134406146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f021400b6e0 con 0xae67f0 2024-09-11T14:55:42.846 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0228d98640 1 -- 172.21.15.52:0/3134406146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f021400b980 con 0xae67f0 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0231b76ec0 1 -- 172.21.15.52:0/3134406146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 msgr2=0xad0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/3134406146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad0690 crc :-1 s=READY pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0231b76ec0 1 -- 172.21.15.52:0/3134406146 shutdown_connections 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/3134406146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad0690 unknown :-1 s=CLOSED pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.844+0000 7f0231b76ec0 1 -- 172.21.15.52:0/3134406146 >> 172.21.15.52:0/3134406146 conn(0x979770 msgr2=0xa3b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.845+0000 7f0231b76ec0 1 -- 172.21.15.52:0/3134406146 shutdown_connections 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.845+0000 7f0231b76ec0 1 -- 172.21.15.52:0/3134406146 wait complete. 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.845+0000 7f0231b76ec0 1 Processor -- start 2024-09-11T14:55:42.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.846+0000 7f0231b76ec0 1 -- start start 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f0231b76ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f0231b76ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x9b7280 con 0xae67f0 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f022a59b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f022a59b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49102/0 (socket says 172.21.15.52:49102) 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f022a59b640 1 -- 172.21.15.52:0/2802016114 learned_addr learned my addr 172.21.15.52:0/2802016114 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f022a59b640 1 -- 172.21.15.52:0/2802016114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x947920 con 0xae67f0 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.847+0000 7f022a59b640 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad7ce0 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.848+0000 7f02237fe640 1 -- 172.21.15.52:0/2802016114 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0214012960 con 0xae67f0 2024-09-11T14:55:42.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.848+0000 7f02237fe640 1 -- 172.21.15.52:0/2802016114 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0214005040 con 0xae67f0 2024-09-11T14:55:42.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.848+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x947380 con 0xae67f0 2024-09-11T14:55:42.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.848+0000 7f02237fe640 1 -- 172.21.15.52:0/2802016114 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0214012bf0 con 0xae67f0 2024-09-11T14:55:42.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.848+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0xad9f60 con 0xae67f0 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.849+0000 7f02237fe640 1 -- 172.21.15.52:0/2802016114 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f021400d040 con 0xae67f0 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.849+0000 7f02237fe640 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f021003d1c0 0x7f021003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.849+0000 7f02237fe640 1 -- 172.21.15.52:0/2802016114 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f021400a040 con 0xae67f0 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.849+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> v2:172.21.15.143:6803/3147275988 conn(0xae7310 0xb7e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.849+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0xadb700 con 0xae7310 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.849+0000 7f0229d9a640 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f021003d1c0 0x7f021003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.850+0000 7f0229d9a640 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f021003d1c0 0x7f021003f6d0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.852 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.850+0000 7f022ad9c640 1 --2- 172.21.15.52:0/2802016114 >> v2:172.21.15.143:6803/3147275988 conn(0xae7310 0xb7e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:42.855 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.854+0000 7f022ad9c640 1 --2- 172.21.15.52:0/2802016114 >> v2:172.21.15.143:6803/3147275988 conn(0xae7310 0xb7e840 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.878+0000 7f022ad9c640 1 -- 172.21.15.52:0/2802016114 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj2 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f021c00a430 con 0xae7310 2024-09-11T14:55:42.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.878+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 >> v2:172.21.15.143:6803/3147275988 conn(0xae7310 msgr2=0xb7e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.878+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> v2:172.21.15.143:6803/3147275988 conn(0xae7310 0xb7e840 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f021003d1c0 msgr2=0x7f021003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f021003d1c0 0x7f021003f6d0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 msgr2=0xad7ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad7ce0 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 shutdown_connections 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> v2:172.21.15.143:6803/3147275988 conn(0xae7310 0xb7e840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f021003d1c0 0x7f021003f6d0 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 --2- 172.21.15.52:0/2802016114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xae67f0 0xad7ce0 unknown :-1 s=CLOSED pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 >> 172.21.15.52:0/2802016114 conn(0x979770 msgr2=0xa3b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 shutdown_connections 2024-09-11T14:55:42.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.879+0000 7f0231b76ec0 1 -- 172.21.15.52:0/2802016114 wait complete. 2024-09-11T14:55:42.882 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:42.882 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj3 /etc/passwd 2024-09-11T14:55:42.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.919+0000 7fc13a22cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.924+0000 7fc13a22cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.925 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.924+0000 7fc13a22cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:42.926 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.925+0000 7fc13a22cec0 1 Processor -- start 2024-09-11T14:55:42.926 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.925+0000 7fc13a22cec0 1 -- start start 2024-09-11T14:55:42.928 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13a22cec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x70a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13a22cec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5db520 con 0x676f80 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13223f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x70a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13223f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x70a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49120/0 (socket says 172.21.15.52:49120) 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13223f640 1 -- 172.21.15.52:0/619720501 learned_addr learned my addr 172.21.15.52:0/619720501 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13223f640 1 -- 172.21.15.52:0/619720501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x577e10 con 0x676f80 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc13223f640 1 --2- 172.21.15.52:0/619720501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x70a490 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e319331a8a73103e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc130a3c640 1 -- 172.21.15.52:0/619720501 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc11c02f0b0 con 0x676f80 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc130a3c640 1 -- 172.21.15.52:0/619720501 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc11c02f210 con 0x676f80 2024-09-11T14:55:42.929 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.927+0000 7fc130a3c640 1 -- 172.21.15.52:0/619720501 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc11c02f4b0 con 0x676f80 2024-09-11T14:55:42.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 -- 172.21.15.52:0/619720501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 msgr2=0x70a490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/619720501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x70a490 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 -- 172.21.15.52:0/619720501 shutdown_connections 2024-09-11T14:55:42.930 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/619720501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x70a490 unknown :-1 s=CLOSED pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 -- 172.21.15.52:0/619720501 >> 172.21.15.52:0/619720501 conn(0x59b770 msgr2=0x671790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 -- 172.21.15.52:0/619720501 shutdown_connections 2024-09-11T14:55:42.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.928+0000 7fc13a22cec0 1 -- 172.21.15.52:0/619720501 wait complete. 2024-09-11T14:55:42.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.929+0000 7fc13a22cec0 1 Processor -- start 2024-09-11T14:55:42.931 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.929+0000 7fc13a22cec0 1 -- start start 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13a22cec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x6f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13a22cec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5d9280 con 0x676f80 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13223f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x6f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13223f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x6f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49128/0 (socket says 172.21.15.52:49128) 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13223f640 1 -- 172.21.15.52:0/3097562506 learned_addr learned my addr 172.21.15.52:0/3097562506 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13223f640 1 -- 172.21.15.52:0/3097562506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x569920 con 0x676f80 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc13223f640 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x6f8aa0 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.931+0000 7fc12b7fe640 1 -- 172.21.15.52:0/3097562506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc11c034040 con 0x676f80 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.932+0000 7fc12b7fe640 1 -- 172.21.15.52:0/3097562506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc11c039370 con 0x676f80 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.932+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x569380 con 0x676f80 2024-09-11T14:55:42.933 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.932+0000 7fc12b7fe640 1 -- 172.21.15.52:0/3097562506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc11c02f4b0 con 0x676f80 2024-09-11T14:55:42.934 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.932+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x6fbd40 con 0x676f80 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.933+0000 7fc12b7fe640 1 -- 172.21.15.52:0/3097562506 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc11c039660 con 0x676f80 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.933+0000 7fc12b7fe640 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc10c03d1c0 0x7fc10c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.933+0000 7fc12b7fe640 1 -- 172.21.15.52:0/3097562506 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7fc11c073b50 con 0x676f80 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.933+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> v2:172.21.15.52:6807/1907008724 conn(0x677cd0 0xba2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.933+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x6fc530 con 0x677cd0 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.933+0000 7fc131a3e640 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc10c03d1c0 0x7fc10c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.934+0000 7fc131a3e640 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc10c03d1c0 0x7fc10c03f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.935 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.934+0000 7fc132a40640 1 --2- 172.21.15.52:0/3097562506 >> v2:172.21.15.52:6807/1907008724 conn(0x677cd0 0xba2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:42.939 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.938+0000 7fc132a40640 1 --2- 172.21.15.52:0/3097562506 >> v2:172.21.15.52:6807/1907008724 conn(0x677cd0 0xba2a60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:42.963 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc132a40640 1 -- 172.21.15.52:0/3097562506 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj3 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc12400c430 con 0x677cd0 2024-09-11T14:55:42.963 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 >> v2:172.21.15.52:6807/1907008724 conn(0x677cd0 msgr2=0xba2a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> v2:172.21.15.52:6807/1907008724 conn(0x677cd0 0xba2a60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc10c03d1c0 msgr2=0x7fc10c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc10c03d1c0 0x7fc10c03f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 msgr2=0x6f8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.961+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x6f8aa0 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 shutdown_connections 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> v2:172.21.15.52:6807/1907008724 conn(0x677cd0 0xba2a60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc10c03d1c0 0x7fc10c03f6d0 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 --2- 172.21.15.52:0/3097562506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x676f80 0x6f8aa0 unknown :-1 s=CLOSED pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 >> 172.21.15.52:0/3097562506 conn(0x59b770 msgr2=0x671790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 shutdown_connections 2024-09-11T14:55:42.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:42.962+0000 7fc13a22cec0 1 -- 172.21.15.52:0/3097562506 wait complete. 2024-09-11T14:55:42.965 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:42.965 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj4 /etc/passwd 2024-09-11T14:55:43.002 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.001+0000 7f3d44430ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.008 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.007+0000 7f3d44430ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.008 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.007+0000 7f3d44430ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.009 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.008+0000 7f3d44430ec0 1 Processor -- start 2024-09-11T14:55:43.009 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.008+0000 7f3d44430ec0 1 -- start start 2024-09-11T14:55:43.011 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d44430ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1c340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.011 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d44430ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1b08520 con 0x1c33740 2024-09-11T14:55:43.011 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1c340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.011 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1c340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49156/0 (socket says 172.21.15.52:49156) 2024-09-11T14:55:43.012 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d377fe640 1 -- 172.21.15.52:0/2059953267 learned_addr learned my addr 172.21.15.52:0/2059953267 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.012 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d377fe640 1 -- 172.21.15.52:0/2059953267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1aa4e10 con 0x1c33740 2024-09-11T14:55:43.012 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d377fe640 1 --2- 172.21.15.52:0/2059953267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1c340f0 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29136066ca2bc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.012 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d35ffb640 1 -- 172.21.15.52:0/2059953267 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3d2800c490 con 0x1c33740 2024-09-11T14:55:43.012 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d35ffb640 1 -- 172.21.15.52:0/2059953267 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3d2800c5f0 con 0x1c33740 2024-09-11T14:55:43.012 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.010+0000 7f3d35ffb640 1 -- 172.21.15.52:0/2059953267 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3d2800c890 con 0x1c33740 2024-09-11T14:55:43.013 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 -- 172.21.15.52:0/2059953267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 msgr2=0x1c340f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.013 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/2059953267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1c340f0 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.013 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 -- 172.21.15.52:0/2059953267 shutdown_connections 2024-09-11T14:55:43.013 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/2059953267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1c340f0 unknown :-1 s=CLOSED pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.013 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 -- 172.21.15.52:0/2059953267 >> 172.21.15.52:0/2059953267 conn(0x1ac8770 msgr2=0x1cbe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.014 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 -- 172.21.15.52:0/2059953267 shutdown_connections 2024-09-11T14:55:43.014 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.011+0000 7f3d44430ec0 1 -- 172.21.15.52:0/2059953267 wait complete. 2024-09-11T14:55:43.014 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.012+0000 7f3d44430ec0 1 Processor -- start 2024-09-11T14:55:43.014 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.012+0000 7f3d44430ec0 1 -- start start 2024-09-11T14:55:43.015 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.013+0000 7f3d44430ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1b9b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.015 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.013+0000 7f3d44430ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1b06280 con 0x1c33740 2024-09-11T14:55:43.015 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.013+0000 7f3d377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1b9b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.015 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1b9b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49170/0 (socket says 172.21.15.52:49170) 2024-09-11T14:55:43.015 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d377fe640 1 -- 172.21.15.52:0/992552102 learned_addr learned my addr 172.21.15.52:0/992552102 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d377fe640 1 -- 172.21.15.52:0/992552102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a96920 con 0x1c33740 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d377fe640 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1b9b350 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d34ff9640 1 -- 172.21.15.52:0/992552102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3d28016040 con 0x1c33740 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d34ff9640 1 -- 172.21.15.52:0/992552102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3d28011b60 con 0x1c33740 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a96380 con 0x1c33740 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d34ff9640 1 -- 172.21.15.52:0/992552102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3d28011e00 con 0x1c33740 2024-09-11T14:55:43.016 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.014+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ba15d0 con 0x1c33740 2024-09-11T14:55:43.017 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.015+0000 7f3d34ff9640 1 -- 172.21.15.52:0/992552102 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3d2800e440 con 0x1c33740 2024-09-11T14:55:43.017 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.015+0000 7f3d34ff9640 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3d2403d1c0 0x7f3d2403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.017 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.015+0000 7f3d34ff9640 1 -- 172.21.15.52:0/992552102 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f3d28050570 con 0x1c33740 2024-09-11T14:55:43.017 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.016+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> v2:172.21.15.52:6802/4284075780 conn(0x1c33b50 0x1c31c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.017 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.016+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x1c23a00 con 0x1c33b50 2024-09-11T14:55:43.018 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.016+0000 7f3d36ffd640 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3d2403d1c0 0x7f3d2403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.018 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.016+0000 7f3d36ffd640 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3d2403d1c0 0x7f3d2403f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.018 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.016+0000 7f3d3cd9c640 1 --2- 172.21.15.52:0/992552102 >> v2:172.21.15.52:6802/4284075780 conn(0x1c33b50 0x1c31c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.020 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.019+0000 7f3d3cd9c640 1 --2- 172.21.15.52:0/992552102 >> v2:172.21.15.52:6802/4284075780 conn(0x1c33b50 0x1c31c70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d3cd9c640 1 -- 172.21.15.52:0/992552102 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== osd_op_reply(1 obj4 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3d3000a430 con 0x1c33b50 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 >> v2:172.21.15.52:6802/4284075780 conn(0x1c33b50 msgr2=0x1c31c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> v2:172.21.15.52:6802/4284075780 conn(0x1c33b50 0x1c31c70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3d2403d1c0 msgr2=0x7f3d2403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3d2403d1c0 0x7f3d2403f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 msgr2=0x1b9b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1b9b350 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 shutdown_connections 2024-09-11T14:55:43.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> v2:172.21.15.52:6802/4284075780 conn(0x1c33b50 0x1c31c70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3d2403d1c0 0x7f3d2403f6d0 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 --2- 172.21.15.52:0/992552102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1c33740 0x1b9b350 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 >> 172.21.15.52:0/992552102 conn(0x1ac8770 msgr2=0x1cbe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 shutdown_connections 2024-09-11T14:55:43.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.043+0000 7f3d44430ec0 1 -- 172.21.15.52:0/992552102 wait complete. 2024-09-11T14:55:43.047 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:43.047 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj5 /etc/passwd 2024-09-11T14:55:43.086 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.085+0000 7f22b923bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.092 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.091+0000 7f22b923bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.092 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.091+0000 7f22b923bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.093 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.092+0000 7f22b923bec0 1 Processor -- start 2024-09-11T14:55:43.093 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.092+0000 7f22b923bec0 1 -- start start 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.093+0000 7f22b923bec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x174a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.093+0000 7f22b923bec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x16b4520 con 0x17478b0 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.093+0000 7f22b139b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x174a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.093+0000 7f22b139b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x174a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49196/0 (socket says 172.21.15.52:49196) 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.093+0000 7f22b139b640 1 -- 172.21.15.52:0/2845546942 learned_addr learned my addr 172.21.15.52:0/2845546942 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.094+0000 7f22b139b640 1 -- 172.21.15.52:0/2845546942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1650e10 con 0x17478b0 2024-09-11T14:55:43.095 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.094+0000 7f22b139b640 1 --2- 172.21.15.52:0/2845546942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x174a730 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf89112f816d17e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.096 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.094+0000 7f22ab7fe640 1 -- 172.21.15.52:0/2845546942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f229c0061f0 con 0x17478b0 2024-09-11T14:55:43.096 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.094+0000 7f22ab7fe640 1 -- 172.21.15.52:0/2845546942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f229c0018f0 con 0x17478b0 2024-09-11T14:55:43.096 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.094+0000 7f22ab7fe640 1 -- 172.21.15.52:0/2845546942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f229c001a60 con 0x17478b0 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 -- 172.21.15.52:0/2845546942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 msgr2=0x174a730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 --2- 172.21.15.52:0/2845546942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x174a730 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 -- 172.21.15.52:0/2845546942 shutdown_connections 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 --2- 172.21.15.52:0/2845546942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x174a730 unknown :-1 s=CLOSED pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 -- 172.21.15.52:0/2845546942 >> 172.21.15.52:0/2845546942 conn(0x1674770 msgr2=0x17e3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 -- 172.21.15.52:0/2845546942 shutdown_connections 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.095+0000 7f22b923bec0 1 -- 172.21.15.52:0/2845546942 wait complete. 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.096+0000 7f22b923bec0 1 Processor -- start 2024-09-11T14:55:43.097 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.096+0000 7f22b923bec0 1 -- start start 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.097+0000 7f22b923bec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x17ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.097+0000 7f22b923bec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x16b2280 con 0x17478b0 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.097+0000 7f22b139b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x17ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.097+0000 7f22b139b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x17ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49210/0 (socket says 172.21.15.52:49210) 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.097+0000 7f22b139b640 1 -- 172.21.15.52:0/3573811293 learned_addr learned my addr 172.21.15.52:0/3573811293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22b139b640 1 -- 172.21.15.52:0/3573811293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1642920 con 0x17478b0 2024-09-11T14:55:43.099 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22b139b640 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x17ce930 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.100 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22aa7fc640 1 -- 172.21.15.52:0/3573811293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f229c011c40 con 0x17478b0 2024-09-11T14:55:43.100 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22aa7fc640 1 -- 172.21.15.52:0/3573811293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f229c011da0 con 0x17478b0 2024-09-11T14:55:43.100 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22aa7fc640 1 -- 172.21.15.52:0/3573811293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f229c012460 con 0x17478b0 2024-09-11T14:55:43.100 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1642380 con 0x17478b0 2024-09-11T14:55:43.100 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.098+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x17cf050 con 0x17478b0 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.099+0000 7f22aa7fc640 1 -- 172.21.15.52:0/3573811293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f229c012610 con 0x17478b0 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.099+0000 7f22aa7fc640 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f228c03d1c0 0x7f228c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.099+0000 7f22aa7fc640 1 -- 172.21.15.52:0/3573811293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f229c04fa10 con 0x17478b0 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.099+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> v2:172.21.15.143:6803/3147275988 conn(0x17e4770 0x17cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.099+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x17de890 con 0x17e4770 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.100+0000 7f22b0b9a640 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f228c03d1c0 0x7f228c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.101 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.100+0000 7f22b0b9a640 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f228c03d1c0 0x7f228c03f6d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.102 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.100+0000 7f22b1b9c640 1 --2- 172.21.15.52:0/3573811293 >> v2:172.21.15.143:6803/3147275988 conn(0x17e4770 0x17cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.105 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.104+0000 7f22b1b9c640 1 --2- 172.21.15.52:0/3573811293 >> v2:172.21.15.143:6803/3147275988 conn(0x17e4770 0x17cc7f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b1b9c640 1 -- 172.21.15.52:0/3573811293 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj5 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f22a400c430 con 0x17e4770 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 >> v2:172.21.15.143:6803/3147275988 conn(0x17e4770 msgr2=0x17cc7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> v2:172.21.15.143:6803/3147275988 conn(0x17e4770 0x17cc7f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f228c03d1c0 msgr2=0x7f228c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f228c03d1c0 0x7f228c03f6d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 msgr2=0x17ce930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x17ce930 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 shutdown_connections 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> v2:172.21.15.143:6803/3147275988 conn(0x17e4770 0x17cc7f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.130 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f228c03d1c0 0x7f228c03f6d0 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 --2- 172.21.15.52:0/3573811293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x17478b0 0x17ce930 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 >> 172.21.15.52:0/3573811293 conn(0x1674770 msgr2=0x17e22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 shutdown_connections 2024-09-11T14:55:43.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.128+0000 7f22b923bec0 1 -- 172.21.15.52:0/3573811293 wait complete. 2024-09-11T14:55:43.132 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:43.132 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj6 /etc/passwd 2024-09-11T14:55:43.170 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.169+0000 7f4bd1b14ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.175 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.174+0000 7f4bd1b14ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.175 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.174+0000 7f4bd1b14ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.176 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.175+0000 7f4bd1b14ec0 1 Processor -- start 2024-09-11T14:55:43.176 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.175+0000 7f4bd1b14ec0 1 -- start start 2024-09-11T14:55:43.178 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bd1b14ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.178 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bd1b14ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x14ba520 con 0x1555f80 2024-09-11T14:55:43.178 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc9e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc9e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49238/0 (socket says 172.21.15.52:49238) 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc9e3f640 1 -- 172.21.15.52:0/2172823101 learned_addr learned my addr 172.21.15.52:0/2172823101 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc9e3f640 1 -- 172.21.15.52:0/2172823101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1456e10 con 0x1555f80 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc9e3f640 1 --2- 172.21.15.52:0/2172823101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d46b0 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1216142686b25e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc37fe640 1 -- 172.21.15.52:0/2172823101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4bb402db90 con 0x1555f80 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc37fe640 1 -- 172.21.15.52:0/2172823101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4bb4037370 con 0x1555f80 2024-09-11T14:55:43.179 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.177+0000 7f4bc37fe640 1 -- 172.21.15.52:0/2172823101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4bb40374e0 con 0x1555f80 2024-09-11T14:55:43.180 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/2172823101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 msgr2=0x15d46b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.180 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/2172823101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d46b0 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.180 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/2172823101 shutdown_connections 2024-09-11T14:55:43.180 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/2172823101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d46b0 unknown :-1 s=CLOSED pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.180 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/2172823101 >> 172.21.15.52:0/2172823101 conn(0x147a770 msgr2=0x1550790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.180 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/2172823101 shutdown_connections 2024-09-11T14:55:43.181 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.178+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/2172823101 wait complete. 2024-09-11T14:55:43.181 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.179+0000 7f4bd1b14ec0 1 Processor -- start 2024-09-11T14:55:43.181 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.179+0000 7f4bd1b14ec0 1 -- start start 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bd1b14ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bd1b14ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x14b8280 con 0x1555f80 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bc9e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bc9e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49254/0 (socket says 172.21.15.52:49254) 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bc9e3f640 1 -- 172.21.15.52:0/79672200 learned_addr learned my addr 172.21.15.52:0/79672200 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bc9e3f640 1 -- 172.21.15.52:0/79672200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1448920 con 0x1555f80 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bc9e3f640 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d7f70 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.181+0000 7f4bc27fc640 1 -- 172.21.15.52:0/79672200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4bb403e040 con 0x1555f80 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.182+0000 7f4bc27fc640 1 -- 172.21.15.52:0/79672200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4bb4037eb0 con 0x1555f80 2024-09-11T14:55:43.183 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.182+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1448380 con 0x1555f80 2024-09-11T14:55:43.184 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.182+0000 7f4bc27fc640 1 -- 172.21.15.52:0/79672200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4bb402db90 con 0x1555f80 2024-09-11T14:55:43.184 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.182+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15dbb80 con 0x1555f80 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.183+0000 7f4bc27fc640 1 -- 172.21.15.52:0/79672200 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4bb4041040 con 0x1555f80 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.183+0000 7f4bc27fc640 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4bb003d1c0 0x7f4bb003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.183+0000 7f4bc27fc640 1 -- 172.21.15.52:0/79672200 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f4bb4032040 con 0x1555f80 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.183+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> v2:172.21.15.52:6807/1907008724 conn(0x1556cd0 0x1a81a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.183+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x15db5c0 con 0x1556cd0 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.183+0000 7f4bc963e640 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4bb003d1c0 0x7f4bb003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.184+0000 7f4bc963e640 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4bb003d1c0 0x7f4bb003f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.185 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.184+0000 7f4bca640640 1 --2- 172.21.15.52:0/79672200 >> v2:172.21.15.52:6807/1907008724 conn(0x1556cd0 0x1a81a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.189 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.188+0000 7f4bca640640 1 --2- 172.21.15.52:0/79672200 >> v2:172.21.15.52:6807/1907008724 conn(0x1556cd0 0x1a81a60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.212+0000 7f4bca640640 1 -- 172.21.15.52:0/79672200 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj6 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4bbc00a430 con 0x1556cd0 2024-09-11T14:55:43.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.212+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 >> v2:172.21.15.52:6807/1907008724 conn(0x1556cd0 msgr2=0x1a81a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.212+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> v2:172.21.15.52:6807/1907008724 conn(0x1556cd0 0x1a81a60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4bb003d1c0 msgr2=0x7f4bb003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4bb003d1c0 0x7f4bb003f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 msgr2=0x15d7f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d7f70 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 shutdown_connections 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> v2:172.21.15.52:6807/1907008724 conn(0x1556cd0 0x1a81a60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4bb003d1c0 0x7f4bb003f6d0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 --2- 172.21.15.52:0/79672200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1555f80 0x15d7f70 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 >> 172.21.15.52:0/79672200 conn(0x147a770 msgr2=0x1550790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 shutdown_connections 2024-09-11T14:55:43.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.213+0000 7f4bd1b14ec0 1 -- 172.21.15.52:0/79672200 wait complete. 2024-09-11T14:55:43.217 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:43.217 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj7 /etc/passwd 2024-09-11T14:55:43.254 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.253+0000 7f6efe174ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.259 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.258+0000 7f6efe174ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.259 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.259+0000 7f6efe174ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.260 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.259+0000 7f6efe174ec0 1 Processor -- start 2024-09-11T14:55:43.260 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.259+0000 7f6efe174ec0 1 -- start start 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6efe174ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x231e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6efe174ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x2206520 con 0x23337f0 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6ef6b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x231e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6ef6b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x231e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49264/0 (socket says 172.21.15.52:49264) 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6ef6b9b640 1 -- 172.21.15.52:0/2325033957 learned_addr learned my addr 172.21.15.52:0/2325033957 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6ef6b9b640 1 -- 172.21.15.52:0/2325033957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x21a2e10 con 0x23337f0 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6ef6b9b640 1 --2- 172.21.15.52:0/2325033957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x231e6a0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a1d51b7cd5023d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.261+0000 7f6ef5398640 1 -- 172.21.15.52:0/2325033957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ee000c490 con 0x23337f0 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6ef5398640 1 -- 172.21.15.52:0/2325033957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ee000c5f0 con 0x23337f0 2024-09-11T14:55:43.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6ef5398640 1 -- 172.21.15.52:0/2325033957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ee000c890 con 0x23337f0 2024-09-11T14:55:43.264 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 -- 172.21.15.52:0/2325033957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 msgr2=0x231e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.264 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/2325033957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x231e6a0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 -- 172.21.15.52:0/2325033957 shutdown_connections 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/2325033957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x231e6a0 unknown :-1 s=CLOSED pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 -- 172.21.15.52:0/2325033957 >> 172.21.15.52:0/2325033957 conn(0x21c6770 msgr2=0x229b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 -- 172.21.15.52:0/2325033957 shutdown_connections 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.262+0000 7f6efe174ec0 1 -- 172.21.15.52:0/2325033957 wait complete. 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.263+0000 7f6efe174ec0 1 Processor -- start 2024-09-11T14:55:43.265 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.263+0000 7f6efe174ec0 1 -- start start 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6efe174ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x23207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6efe174ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x2204280 con 0x23337f0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6ef6b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x23207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6ef6b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x23207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49268/0 (socket says 172.21.15.52:49268) 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6ef6b9b640 1 -- 172.21.15.52:0/1788213657 learned_addr learned my addr 172.21.15.52:0/1788213657 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6ef6b9b640 1 -- 172.21.15.52:0/1788213657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2194920 con 0x23337f0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6ef6b9b640 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x23207a0 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6eeffff640 1 -- 172.21.15.52:0/1788213657 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ee00111e0 con 0x23337f0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.265+0000 7f6eeffff640 1 -- 172.21.15.52:0/1788213657 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ee00119d0 con 0x23337f0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.266+0000 7f6eeffff640 1 -- 172.21.15.52:0/1788213657 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ee0011b40 con 0x23337f0 2024-09-11T14:55:43.267 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.266+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2194380 con 0x23337f0 2024-09-11T14:55:43.268 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.266+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2324400 con 0x23337f0 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.266+0000 7f6eeffff640 1 -- 172.21.15.52:0/1788213657 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6ee0011cf0 con 0x23337f0 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.267+0000 7f6eeffff640 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6edc03f3d0 0x7f6edc0418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.267+0000 7f6eeffff640 1 -- 172.21.15.52:0/1788213657 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f6ee0050040 con 0x23337f0 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.267+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> v2:172.21.15.52:6802/4284075780 conn(0x2334310 0x23211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.267+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x27cb830 con 0x2334310 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.267+0000 7f6ef639a640 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6edc03f3d0 0x7f6edc0418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.268+0000 7f6ef639a640 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6edc03f3d0 0x7f6edc0418e0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.269 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.268+0000 7f6ef739c640 1 --2- 172.21.15.52:0/1788213657 >> v2:172.21.15.52:6802/4284075780 conn(0x2334310 0x23211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.272 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.272+0000 7f6ef739c640 1 --2- 172.21.15.52:0/1788213657 >> v2:172.21.15.52:6802/4284075780 conn(0x2334310 0x23211f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6ef739c640 1 -- 172.21.15.52:0/1788213657 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== osd_op_reply(1 obj7 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee800a430 con 0x2334310 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 >> v2:172.21.15.52:6802/4284075780 conn(0x2334310 msgr2=0x23211f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> v2:172.21.15.52:6802/4284075780 conn(0x2334310 0x23211f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6edc03f3d0 msgr2=0x7f6edc0418e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6edc03f3d0 0x7f6edc0418e0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 msgr2=0x23207a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x23207a0 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 shutdown_connections 2024-09-11T14:55:43.297 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> v2:172.21.15.52:6802/4284075780 conn(0x2334310 0x23211f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6edc03f3d0 0x7f6edc0418e0 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 --2- 172.21.15.52:0/1788213657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x23337f0 0x23207a0 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 >> 172.21.15.52:0/1788213657 conn(0x21c6770 msgr2=0x229b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 shutdown_connections 2024-09-11T14:55:43.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.295+0000 7f6efe174ec0 1 -- 172.21.15.52:0/1788213657 wait complete. 2024-09-11T14:55:43.299 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:43.299 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj8 /etc/passwd 2024-09-11T14:55:43.336 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.335+0000 7f62d8681ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.342 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.341+0000 7f62d8681ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.342 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.341+0000 7f62d8681ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.343 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.342+0000 7f62d8681ec0 1 Processor -- start 2024-09-11T14:55:43.343 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.342+0000 7f62d8681ec0 1 -- start start 2024-09-11T14:55:43.345 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.343+0000 7f62d8681ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 0x1148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.345 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.343+0000 7f62d8681ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x101c520 con 0x1147740 2024-09-11T14:55:43.345 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 0x1148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.345 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 0x1148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49296/0 (socket says 172.21.15.52:49296) 2024-09-11T14:55:43.345 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62cb7fe640 1 -- 172.21.15.52:0/3742733887 learned_addr learned my addr 172.21.15.52:0/3742733887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.346 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62cb7fe640 1 -- 172.21.15.52:0/3742733887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfb8e10 con 0x1147740 2024-09-11T14:55:43.346 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62cb7fe640 1 --2- 172.21.15.52:0/3742733887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 0x1148dc0 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fa657b64514d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.346 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62c9ffb640 1 -- 172.21.15.52:0/3742733887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62bc032040 con 0x1147740 2024-09-11T14:55:43.346 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62c9ffb640 1 -- 172.21.15.52:0/3742733887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62bc033040 con 0x1147740 2024-09-11T14:55:43.346 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.344+0000 7f62c9ffb640 1 -- 172.21.15.52:0/3742733887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62bc02db70 con 0x1147740 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 -- 172.21.15.52:0/3742733887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 msgr2=0x1148dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/3742733887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 0x1148dc0 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 -- 172.21.15.52:0/3742733887 shutdown_connections 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/3742733887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1147740 0x1148dc0 unknown :-1 s=CLOSED pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 -- 172.21.15.52:0/3742733887 >> 172.21.15.52:0/3742733887 conn(0xfdc770 msgr2=0x11d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 -- 172.21.15.52:0/3742733887 shutdown_connections 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.345+0000 7f62d8681ec0 1 -- 172.21.15.52:0/3742733887 wait complete. 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.346+0000 7f62d8681ec0 1 Processor -- start 2024-09-11T14:55:43.347 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.346+0000 7f62d8681ec0 1 -- start start 2024-09-11T14:55:43.349 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.347+0000 7f62d8681ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 0x11dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.349 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.347+0000 7f62d8681ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x101a280 con 0x114a500 2024-09-11T14:55:43.349 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 0x11dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 0x11dfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49302/0 (socket says 172.21.15.52:49302) 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62cb7fe640 1 -- 172.21.15.52:0/2186627032 learned_addr learned my addr 172.21.15.52:0/2186627032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62cb7fe640 1 -- 172.21.15.52:0/2186627032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfaa920 con 0x114a500 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62cb7fe640 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 0x11dfa30 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62c8ff9640 1 -- 172.21.15.52:0/2186627032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62bc032040 con 0x114a500 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62c8ff9640 1 -- 172.21.15.52:0/2186627032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62bc02d490 con 0x114a500 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xfaa380 con 0x114a500 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62c8ff9640 1 -- 172.21.15.52:0/2186627032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62bc02de50 con 0x114a500 2024-09-11T14:55:43.350 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.348+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1135e30 con 0x114a500 2024-09-11T14:55:43.351 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.349+0000 7f62c8ff9640 1 -- 172.21.15.52:0/2186627032 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f62bc003040 con 0x114a500 2024-09-11T14:55:43.351 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.349+0000 7f62c8ff9640 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f62b803d170 0x7f62b803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.351 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.349+0000 7f62c8ff9640 1 -- 172.21.15.52:0/2186627032 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f62bc072dd0 con 0x114a500 2024-09-11T14:55:43.351 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.350+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> v2:172.21.15.143:6808/2099775818 conn(0x1145e70 0x1146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.352 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.350+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 --> v2:172.21.15.143:6808/2099775818 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x1139430 con 0x1145e70 2024-09-11T14:55:43.352 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.350+0000 7f62caffd640 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f62b803d170 0x7f62b803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.352 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.350+0000 7f62caffd640 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f62b803d170 0x7f62b803f680 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.352 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.351+0000 7f62d0f9c640 1 --2- 172.21.15.52:0/2186627032 >> v2:172.21.15.143:6808/2099775818 conn(0x1145e70 0x1146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.355 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.354+0000 7f62d0f9c640 1 --2- 172.21.15.52:0/2186627032 >> v2:172.21.15.143:6808/2099775818 conn(0x1145e70 0x1146280 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d0f9c640 1 -- 172.21.15.52:0/2186627032 <== osd.2 v2:172.21.15.143:6808/2099775818 1 ==== osd_op_reply(1 obj8 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62c400c430 con 0x1145e70 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 >> v2:172.21.15.143:6808/2099775818 conn(0x1145e70 msgr2=0x1146280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> v2:172.21.15.143:6808/2099775818 conn(0x1145e70 0x1146280 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f62b803d170 msgr2=0x7f62b803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f62b803d170 0x7f62b803f680 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 msgr2=0x11dfa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 0x11dfa30 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.379 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 shutdown_connections 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> v2:172.21.15.143:6808/2099775818 conn(0x1145e70 0x1146280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f62b803d170 0x7f62b803f680 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 --2- 172.21.15.52:0/2186627032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x114a500 0x11dfa30 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 >> 172.21.15.52:0/2186627032 conn(0xfdc770 msgr2=0x11d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 shutdown_connections 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.377+0000 7f62d8681ec0 1 -- 172.21.15.52:0/2186627032 wait complete. 2024-09-11T14:55:43.380 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:43.381 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj9 /etc/passwd 2024-09-11T14:55:43.418 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.417+0000 7f0ccb860ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.424 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.423+0000 7f0ccb860ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.424 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.423+0000 7f0ccb860ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.425 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.424+0000 7f0ccb860ec0 1 Processor -- start 2024-09-11T14:55:43.425 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.424+0000 7f0ccb860ec0 1 -- start start 2024-09-11T14:55:43.427 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0ccb860ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x26e2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.427 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0ccb860ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x252c520 con 0x2657740 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x26e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x26e2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49318/0 (socket says 172.21.15.52:49318) 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbeffd640 1 -- 172.21.15.52:0/3826026126 learned_addr learned my addr 172.21.15.52:0/3826026126 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbeffd640 1 -- 172.21.15.52:0/3826026126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24c8e10 con 0x2657740 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbeffd640 1 --2- 172.21.15.52:0/3826026126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x26e2560 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f5509589293bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbdffb640 1 -- 172.21.15.52:0/3826026126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0cb002d7f0 con 0x2657740 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbdffb640 1 -- 172.21.15.52:0/3826026126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0cb002dac0 con 0x2657740 2024-09-11T14:55:43.428 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.426+0000 7f0cbdffb640 1 -- 172.21.15.52:0/3826026126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0cb000a040 con 0x2657740 2024-09-11T14:55:43.429 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/3826026126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 msgr2=0x26e2560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.429 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/3826026126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x26e2560 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.429 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/3826026126 shutdown_connections 2024-09-11T14:55:43.430 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/3826026126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x26e2560 unknown :-1 s=CLOSED pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.430 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/3826026126 >> 172.21.15.52:0/3826026126 conn(0x24ec770 msgr2=0x265b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.430 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/3826026126 shutdown_connections 2024-09-11T14:55:43.430 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.427+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/3826026126 wait complete. 2024-09-11T14:55:43.430 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.428+0000 7f0ccb860ec0 1 Processor -- start 2024-09-11T14:55:43.430 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.428+0000 7f0ccb860ec0 1 -- start start 2024-09-11T14:55:43.431 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.429+0000 7f0ccb860ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x2643640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.431 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.429+0000 7f0ccb860ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x252a280 con 0x2657740 2024-09-11T14:55:43.431 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x2643640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x2643640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49334/0 (socket says 172.21.15.52:49334) 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbeffd640 1 -- 172.21.15.52:0/1375299013 learned_addr learned my addr 172.21.15.52:0/1375299013 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbeffd640 1 -- 172.21.15.52:0/1375299013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24ba920 con 0x2657740 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbeffd640 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x2643640 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbcff9640 1 -- 172.21.15.52:0/1375299013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0cb003f040 con 0x2657740 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbcff9640 1 -- 172.21.15.52:0/1375299013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0cb000a320 con 0x2657740 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x24ba380 con 0x2657740 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0cbcff9640 1 -- 172.21.15.52:0/1375299013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0cb002d7a0 con 0x2657740 2024-09-11T14:55:43.432 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.430+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2656e00 con 0x2657740 2024-09-11T14:55:43.433 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.431+0000 7f0cbcff9640 1 -- 172.21.15.52:0/1375299013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0cb00383e0 con 0x2657740 2024-09-11T14:55:43.433 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.432+0000 7f0cbcff9640 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ca003d1c0 0x7f0ca003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.434 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.432+0000 7f0cbcff9640 1 -- 172.21.15.52:0/1375299013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7f0cb0032040 con 0x2657740 2024-09-11T14:55:43.434 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.432+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> v2:172.21.15.52:6807/1907008724 conn(0x265a500 0x26ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.434 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.432+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x2645100 con 0x265a500 2024-09-11T14:55:43.434 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.432+0000 7f0cb67fc640 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ca003d1c0 0x7f0ca003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.434 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.432+0000 7f0cb67fc640 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ca003d1c0 0x7f0ca003f6d0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.434 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.433+0000 7f0cbf7fe640 1 --2- 172.21.15.52:0/1375299013 >> v2:172.21.15.52:6807/1907008724 conn(0x265a500 0x26ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.436 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.435+0000 7f0cbf7fe640 1 --2- 172.21.15.52:0/1375299013 >> v2:172.21.15.52:6807/1907008724 conn(0x265a500 0x26ef5e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.481 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.479+0000 7f0cbf7fe640 1 -- 172.21.15.52:0/1375299013 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj9 [writefull 0~12777] v705'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0cb800a430 con 0x265a500 2024-09-11T14:55:43.481 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 >> v2:172.21.15.52:6807/1907008724 conn(0x265a500 msgr2=0x26ef5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> v2:172.21.15.52:6807/1907008724 conn(0x265a500 0x26ef5e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ca003d1c0 msgr2=0x7f0ca003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ca003d1c0 0x7f0ca003f6d0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 msgr2=0x2643640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x2643640 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 shutdown_connections 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> v2:172.21.15.52:6807/1907008724 conn(0x265a500 0x26ef5e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ca003d1c0 0x7f0ca003f6d0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 --2- 172.21.15.52:0/1375299013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2657740 0x2643640 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 >> 172.21.15.52:0/1375299013 conn(0x24ec770 msgr2=0x25c4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 shutdown_connections 2024-09-11T14:55:43.482 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.480+0000 7f0ccb860ec0 1 -- 172.21.15.52:0/1375299013 wait complete. 2024-09-11T14:55:43.483 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:55:43.483 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put obj10 /etc/passwd 2024-09-11T14:55:43.521 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.520+0000 7fd53e441ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.526 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.525+0000 7fd53e441ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.526 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.526+0000 7fd53e441ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:55:43.527 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.526+0000 7fd53e441ec0 1 Processor -- start 2024-09-11T14:55:43.527 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.527+0000 7fd53e441ec0 1 -- start start 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.528+0000 7fd53e441ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xccf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.528+0000 7fd53e441ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xb1a520 con 0xbad8b0 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.528+0000 7fd53659b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xccf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.528+0000 7fd53659b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xccf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34960/0 (socket says 172.21.15.52:34960) 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.528+0000 7fd53659b640 1 -- 172.21.15.52:0/294053655 learned_addr learned my addr 172.21.15.52:0/294053655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.528+0000 7fd53659b640 1 -- 172.21.15.52:0/294053655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xab6e10 con 0xbad8b0 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53659b640 1 --2- 172.21.15.52:0/294053655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xccf480 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65bdecfd995f26f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd534d98640 1 -- 172.21.15.52:0/294053655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd52002db90 con 0xbad8b0 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd534d98640 1 -- 172.21.15.52:0/294053655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd52002dcf0 con 0xbad8b0 2024-09-11T14:55:43.530 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd534d98640 1 -- 172.21.15.52:0/294053655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5200374a0 con 0xbad8b0 2024-09-11T14:55:43.531 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 -- 172.21.15.52:0/294053655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 msgr2=0xccf480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.531 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/294053655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xccf480 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.531 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 -- 172.21.15.52:0/294053655 shutdown_connections 2024-09-11T14:55:43.532 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/294053655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xccf480 unknown :-1 s=CLOSED pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.532 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 -- 172.21.15.52:0/294053655 >> 172.21.15.52:0/294053655 conn(0xada770 msgr2=0xc48050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.532 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 -- 172.21.15.52:0/294053655 shutdown_connections 2024-09-11T14:55:43.532 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.529+0000 7fd53e441ec0 1 -- 172.21.15.52:0/294053655 wait complete. 2024-09-11T14:55:43.532 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.530+0000 7fd53e441ec0 1 Processor -- start 2024-09-11T14:55:43.532 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.531+0000 7fd53e441ec0 1 -- start start 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.532+0000 7fd53e441ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xbb5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.532+0000 7fd53e441ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xb18280 con 0xbad8b0 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.532+0000 7fd53659b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xbb5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.532+0000 7fd53659b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xbb5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34966/0 (socket says 172.21.15.52:34966) 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.532+0000 7fd53659b640 1 -- 172.21.15.52:0/3760170061 learned_addr learned my addr 172.21.15.52:0/3760170061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.532+0000 7fd53659b640 1 -- 172.21.15.52:0/3760170061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xaa8920 con 0xbad8b0 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.533+0000 7fd53659b640 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xbb5190 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.533+0000 7fd52f7fe640 1 -- 172.21.15.52:0/3760170061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd52003e040 con 0xbad8b0 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.533+0000 7fd52f7fe640 1 -- 172.21.15.52:0/3760170061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd5200057c0 con 0xbad8b0 2024-09-11T14:55:43.534 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.533+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xaa8380 con 0xbad8b0 2024-09-11T14:55:43.535 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.533+0000 7fd52f7fe640 1 -- 172.21.15.52:0/3760170061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd5200374a0 con 0xbad8b0 2024-09-11T14:55:43.535 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.533+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc37580 con 0xbad8b0 2024-09-11T14:55:43.535 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.534+0000 7fd52f7fe640 1 -- 172.21.15.52:0/3760170061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd520039450 con 0xbad8b0 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.534+0000 7fd52f7fe640 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd51c03d160 0x7fd51c03f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.534+0000 7fd52f7fe640 1 -- 172.21.15.52:0/3760170061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(705..705 src has 412..705) ==== 3819+0+0 (crc 0 0 0) 0x7fd520032040 con 0xbad8b0 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.534+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> v2:172.21.15.52:6807/1907008724 conn(0xbae200 0xc43eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.534+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0xcd0130 con 0xbae200 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.535+0000 7fd535d9a640 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd51c03d160 0x7fd51c03f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.535+0000 7fd535d9a640 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd51c03d160 0x7fd51c03f670 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.536 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.535+0000 7fd536d9c640 1 --2- 172.21.15.52:0/3760170061 >> v2:172.21.15.52:6807/1907008724 conn(0xbae200 0xc43eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:55:43.540 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.539+0000 7fd536d9c640 1 --2- 172.21.15.52:0/3760170061 >> v2:172.21.15.52:6807/1907008724 conn(0xbae200 0xc43eb0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:55:43.564 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.562+0000 7fd536d9c640 1 -- 172.21.15.52:0/3760170061 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj10 [writefull 0~12777] v705'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd52800a430 con 0xbae200 2024-09-11T14:55:43.564 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.562+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 >> v2:172.21.15.52:6807/1907008724 conn(0xbae200 msgr2=0xc43eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.564 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.562+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> v2:172.21.15.52:6807/1907008724 conn(0xbae200 0xc43eb0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.564 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd51c03d160 msgr2=0x7fd51c03f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd51c03d160 0x7fd51c03f670 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 msgr2=0xbb5190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xbb5190 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 shutdown_connections 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> v2:172.21.15.52:6807/1907008724 conn(0xbae200 0xc43eb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd51c03d160 0x7fd51c03f670 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 --2- 172.21.15.52:0/3760170061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xbad8b0 0xbb5190 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 >> 172.21.15.52:0/3760170061 conn(0xada770 msgr2=0xbb7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 shutdown_connections 2024-09-11T14:55:43.565 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:55:43.563+0000 7fd53e441ec0 1 -- 172.21.15.52:0/3760170061 wait complete. 2024-09-11T14:55:43.566 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 30 2024-09-11T14:56:13.569 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=95873 2024-09-11T14:56:13.569 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_objects 100 2024-09-11T14:56:13.569 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put onemore /etc/passwd 2024-09-11T14:56:13.613 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.612+0000 7f96b443fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:13.620 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.619+0000 7f96b443fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:13.620 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.619+0000 7f96b443fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:13.621 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.620+0000 7f96b443fec0 1 Processor -- start 2024-09-11T14:56:13.621 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.620+0000 7f96b443fec0 1 -- start start 2024-09-11T14:56:13.623 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96b443fec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x13e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.624 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96b443fec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1351520 con 0x147cec0 2024-09-11T14:56:13.624 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x13e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:13.624 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x13e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45532/0 (socket says 172.21.15.52:45532) 2024-09-11T14:56:13.624 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96a77fe640 1 -- 172.21.15.52:0/246015435 learned_addr learned my addr 172.21.15.52:0/246015435 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:13.624 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96a77fe640 1 -- 172.21.15.52:0/246015435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12ede10 con 0x147cec0 2024-09-11T14:56:13.624 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.622+0000 7f96a77fe640 1 --2- 172.21.15.52:0/246015435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x13e7de0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918e510de6a34e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.625 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.623+0000 7f96a5ffb640 1 -- 172.21.15.52:0/246015435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f969800c770 con 0x147cec0 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.623+0000 7f96a5ffb640 1 -- 172.21.15.52:0/246015435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f969800c8d0 con 0x147cec0 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.623+0000 7f96a5ffb640 1 -- 172.21.15.52:0/246015435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f969800cb70 con 0x147cec0 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 -- 172.21.15.52:0/246015435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 msgr2=0x13e7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 --2- 172.21.15.52:0/246015435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x13e7de0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 -- 172.21.15.52:0/246015435 shutdown_connections 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 --2- 172.21.15.52:0/246015435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x13e7de0 unknown :-1 s=CLOSED pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 -- 172.21.15.52:0/246015435 >> 172.21.15.52:0/246015435 conn(0x1311770 msgr2=0x13ed530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 -- 172.21.15.52:0/246015435 shutdown_connections 2024-09-11T14:56:13.626 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.624+0000 7f96b443fec0 1 -- 172.21.15.52:0/246015435 wait complete. 2024-09-11T14:56:13.627 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.625+0000 7f96b443fec0 1 Processor -- start 2024-09-11T14:56:13.627 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.625+0000 7f96b443fec0 1 -- start start 2024-09-11T14:56:13.628 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.627+0000 7f96b443fec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x15125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.628 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.627+0000 7f96b443fec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x134f280 con 0x147cec0 2024-09-11T14:56:13.628 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.627+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x15125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:13.628 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.627+0000 7f96a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x15125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45542/0 (socket says 172.21.15.52:45542) 2024-09-11T14:56:13.628 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.627+0000 7f96a77fe640 1 -- 172.21.15.52:0/2688582310 learned_addr learned my addr 172.21.15.52:0/2688582310 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:13.629 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96a77fe640 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12df920 con 0x147cec0 2024-09-11T14:56:13.630 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96a77fe640 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x15125e0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.630 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9698012040 con 0x147cec0 2024-09-11T14:56:13.630 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9698013040 con 0x147cec0 2024-09-11T14:56:13.630 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x12df380 con 0x147cec0 2024-09-11T14:56:13.630 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f96980093a0 con 0x147cec0 2024-09-11T14:56:13.630 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.628+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x150a910 con 0x147cec0 2024-09-11T14:56:13.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.630+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9698009550 con 0x147cec0 2024-09-11T14:56:13.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.630+0000 7f96a4ff9640 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f969403d170 0x7f969403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.630+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(707..707 src has 412..707) ==== 3819+0+0 (crc 0 0 0) 0x7f9698051af0 con 0x147cec0 2024-09-11T14:56:13.631 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.630+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f9694043460 con 0x147cec0 2024-09-11T14:56:13.632 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.631+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> v2:172.21.15.143:6808/2099775818 conn(0x1480f70 0x15077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.632 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.631+0000 7f96a6ffd640 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f969403d170 0x7f969403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:13.632 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.631+0000 7f96a6ffd640 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f969403d170 0x7f969403f680 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.633 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.632+0000 7f96acd9c640 1 --2- 172.21.15.52:0/2688582310 >> v2:172.21.15.143:6808/2099775818 conn(0x1480f70 0x15077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:56:13.637 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.636+0000 7f96acd9c640 1 --2- 172.21.15.52:0/2688582310 >> v2:172.21.15.143:6808/2099775818 conn(0x1480f70 0x15077d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.671+0000 7f5315351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:13.683 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.682+0000 7f5315351640 1 Processor -- start 2024-09-11T14:56:13.683 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.682+0000 7f5315351640 1 -- start start 2024-09-11T14:56:13.685 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.683+0000 7f5315351640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53101364c0 0x7f53101368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.685 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f5315351640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53100a16a0 con 0x7f5310136e10 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f5315351640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f53100a0a00 con 0x7f53101364c0 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53101364c0 0x7f53101368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530e7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5310136e10 0x7f531009f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39072/0 (socket says 172.21.15.52:39072) 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53101364c0 0x7f53101368d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45548/0 (socket says 172.21.15.52:45548) 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530e7fc640 1 -- 172.21.15.52:0/1532653838 learned_addr learned my addr 172.21.15.52:0/1532653838 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530effd640 1 -- 172.21.15.52:0/1532653838 >> v1:172.21.15.52:6789/0 conn(0x7f5310136e10 legacy=0x7f531009f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530effd640 1 -- 172.21.15.52:0/1532653838 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53100a13b0 con 0x7f53101364c0 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530dffb640 1 -- 172.21.15.52:0/1532653838 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899796029 0 0) 0x7f53100a16a0 con 0x7f5310136e10 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530effd640 1 --2- 172.21.15.52:0/1532653838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101368d0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fac7090457ccd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530dffb640 1 -- 172.21.15.52:0/1532653838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5300009d90 con 0x7f53101364c0 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530dffb640 1 -- 172.21.15.52:0/1532653838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f530000e230 con 0x7f53101364c0 2024-09-11T14:56:13.686 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.684+0000 7f530dffb640 1 -- 172.21.15.52:0/1532653838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f530000e4d0 con 0x7f53101364c0 2024-09-11T14:56:13.687 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 -- 172.21.15.52:0/1532653838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 msgr2=0x7f53101368d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:13.687 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 --2- 172.21.15.52:0/1532653838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101368d0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:13.687 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 -- 172.21.15.52:0/1532653838 shutdown_connections 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 --2- 172.21.15.52:0/1532653838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101368d0 unknown :-1 s=CLOSED pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 -- 172.21.15.52:0/1532653838 >> 172.21.15.52:0/1532653838 conn(0x7f53100a6270 msgr2=0x7f53100a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 -- 172.21.15.52:0/1532653838 shutdown_connections 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.685+0000 7f5315351640 1 -- 172.21.15.52:0/1532653838 wait complete. 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.686+0000 7f5315351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.687+0000 7f5315351640 1 Processor -- start 2024-09-11T14:56:13.688 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.688+0000 7f5315351640 1 -- start start 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.689+0000 7f5315351640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.689+0000 7f5315351640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5310136100 con 0x7f53101364c0 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.689+0000 7f530effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.689+0000 7f530effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45554/0 (socket says 172.21.15.52:45554) 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.689+0000 7f530effd640 1 -- 172.21.15.52:0/3262867412 learned_addr learned my addr 172.21.15.52:0/3262867412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.689+0000 7f530effd640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53100a4210 con 0x7f53101364c0 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.690+0000 7f530effd640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101ca850 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.690+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5300013610 con 0x7f53101364c0 2024-09-11T14:56:13.692 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.690+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5300013770 con 0x7f53101364c0 2024-09-11T14:56:13.692 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.690+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5310132260 con 0x7f53101364c0 2024-09-11T14:56:13.692 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.690+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5300013a10 con 0x7f53101364c0 2024-09-11T14:56:13.692 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.690+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101343c0 con 0x7f53101364c0 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.691+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53100a2230 con 0x7f53101364c0 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.691+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5300013c10 con 0x7f53101364c0 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.691+0000 7f52f77fe640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f52fc03e8e0 0x7f52fc040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.691+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(707..707 src has 412..707) ==== 3819+0+0 (crc 0 0 0) 0x7f5300018040 con 0x7f53101364c0 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.691+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f52fc044b70 con 0x7f53101364c0 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.692+0000 7f530e7fc640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f52fc03e8e0 0x7f52fc040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:13.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.692+0000 7f530e7fc640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f52fc03e8e0 0x7f52fc040df0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:13.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.696+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5300011570 con 0x7f53101364c0 2024-09-11T14:56:13.913 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:13.912+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "100"} v 0) -- 0x7f5310050fc0 con 0x7f53101364c0 2024-09-11T14:56:14.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:14.211+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v708) ==== 225+0+0 (crc 0 0 0) 0x7f53000080b0 con 0x7f53101364c0 2024-09-11T14:56:14.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:14.211+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 6 ==== osd_map(708..708 src has 412..708) ==== 628+0+0 (crc 0 0 0) 0x7f9698013e50 con 0x147cec0 2024-09-11T14:56:14.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:14.212+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f9694043ba0 con 0x147cec0 2024-09-11T14:56:14.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:14.211+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(708..708 src has 412..708) ==== 628+0+0 (crc 0 0 0) 0x7f5300012e30 con 0x7f53101364c0 2024-09-11T14:56:14.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:14.212+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f52fc045af0 con 0x7f53101364c0 2024-09-11T14:56:14.335 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:14.334+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "100"} v 0) -- 0x7f5310136de0 con 0x7f53101364c0 2024-09-11T14:56:15.221 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.219+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v709) ==== 225+0+0 (crc 0 0 0) 0x7f5300018bf0 con 0x7f53101364c0 2024-09-11T14:56:15.221 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_objects = 100 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:56:15.221 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.220+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 <== mon.0 v2:172.21.15.52:3300/0 10 ==== osd_map(709..709 src has 412..709) ==== 628+0+0 (crc 0 0 0) 0x7f5300017190 con 0x7f53101364c0 2024-09-11T14:56:15.221 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.220+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 7 ==== osd_map(709..709 src has 412..709) ==== 628+0+0 (crc 0 0 0) 0x7f9698015290 con 0x147cec0 2024-09-11T14:56:15.221 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.220+0000 7f52f77fe640 1 -- 172.21.15.52:0/3262867412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7f52fc045c10 con 0x7f53101364c0 2024-09-11T14:56:15.221 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.220+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7f9694043e80 con 0x147cec0 2024-09-11T14:56:15.225 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f52fc03e8e0 msgr2=0x7f52fc040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:15.225 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f52fc03e8e0 0x7f52fc040df0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:15.225 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 msgr2=0x7f53101ca850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:15.225 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101ca850 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:15.226 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 shutdown_connections 2024-09-11T14:56:15.226 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f52fc03e8e0 0x7f52fc040df0 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:15.226 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 --2- 172.21.15.52:0/3262867412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53101364c0 0x7f53101ca850 unknown :-1 s=CLOSED pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:15.226 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 >> 172.21.15.52:0/3262867412 conn(0x7f53100a6270 msgr2=0x7f53100714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:15.226 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 shutdown_connections 2024-09-11T14:56:15.226 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:15.224+0000 7f5315351640 1 -- 172.21.15.52:0/3262867412 wait complete. 2024-09-11T14:56:15.245 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 95873 2024-09-11T14:56:16.669 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.668+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(710..710 src has 412..710) ==== 628+0+0 (crc 0 0 0) 0x7f9698014e30 con 0x147cec0 2024-09-11T14:56:16.669 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.668+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7f9694043e80 con 0x147cec0 2024-09-11T14:56:16.669 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.668+0000 7f96a4ff9640 1 -- 172.21.15.52:0/2688582310 --> v2:172.21.15.143:6808/2099775818 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x7f96940440d0 con 0x1480f70 2024-09-11T14:56:16.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96acd9c640 1 -- 172.21.15.52:0/2688582310 <== osd.2 v2:172.21.15.143:6808/2099775818 1 ==== osd_op_reply(1 onemore [writefull 0~12777] v710'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f96a000a430 con 0x1480f70 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 >> v2:172.21.15.143:6808/2099775818 conn(0x1480f70 msgr2=0x15077d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> v2:172.21.15.143:6808/2099775818 conn(0x1480f70 0x15077d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f969403d170 msgr2=0x7f969403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f969403d170 0x7f969403f680 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 msgr2=0x15125e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x15125e0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 shutdown_connections 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> v2:172.21.15.143:6808/2099775818 conn(0x1480f70 0x15077d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f969403d170 0x7f969403f680 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 --2- 172.21.15.52:0/2688582310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x147cec0 0x15125e0 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 >> 172.21.15.52:0/2688582310 conn(0x1311770 msgr2=0x13ef1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:16.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 shutdown_connections 2024-09-11T14:56:16.757 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.754+0000 7f96b443fec0 1 -- 172.21.15.52:0/2688582310 wait complete. 2024-09-11T14:56:16.758 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T14:56:16.758 INFO:tasks.workunit.client.0.smithi052.stderr:+ true 2024-09-11T14:56:16.758 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put twomore /etc/passwd 2024-09-11T14:56:16.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.796+0000 7f2c96068ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:16.802 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.802+0000 7f2c96068ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:16.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.802+0000 7f2c96068ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:16.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.803+0000 7f2c96068ec0 1 Processor -- start 2024-09-11T14:56:16.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.803+0000 7f2c96068ec0 1 -- start start 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.804+0000 7f2c96068ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.804+0000 7f2c96068ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xb82520 con 0xc1dd70 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.804+0000 7f2c8e19b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.804+0000 7f2c8e19b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45568/0 (socket says 172.21.15.52:45568) 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.804+0000 7f2c8e19b640 1 -- 172.21.15.52:0/3188534703 learned_addr learned my addr 172.21.15.52:0/3188534703 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.804+0000 7f2c8e19b640 1 -- 172.21.15.52:0/3188534703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb1ee10 con 0xc1dd70 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c8e19b640 1 --2- 172.21.15.52:0/3188534703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcad480 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5075107f2973ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c8c998640 1 -- 172.21.15.52:0/3188534703 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c7802dc20 con 0xc1dd70 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c8c998640 1 -- 172.21.15.52:0/3188534703 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c78037370 con 0xc1dd70 2024-09-11T14:56:16.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c8c998640 1 -- 172.21.15.52:0/3188534703 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c78037610 con 0xc1dd70 2024-09-11T14:56:16.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c96068ec0 1 -- 172.21.15.52:0/3188534703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 msgr2=0xcad480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/3188534703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcad480 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c96068ec0 1 -- 172.21.15.52:0/3188534703 shutdown_connections 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/3188534703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcad480 unknown :-1 s=CLOSED pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.805+0000 7f2c96068ec0 1 -- 172.21.15.52:0/3188534703 >> 172.21.15.52:0/3188534703 conn(0xb42770 msgr2=0xc1a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.806+0000 7f2c96068ec0 1 -- 172.21.15.52:0/3188534703 shutdown_connections 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.806+0000 7f2c96068ec0 1 -- 172.21.15.52:0/3188534703 wait complete. 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.807+0000 7f2c96068ec0 1 Processor -- start 2024-09-11T14:56:16.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.807+0000 7f2c96068ec0 1 -- start start 2024-09-11T14:56:16.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.808+0000 7f2c96068ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.808+0000 7f2c96068ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xb80280 con 0xc1dd70 2024-09-11T14:56:16.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.808+0000 7f2c8e19b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:16.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.808+0000 7f2c8e19b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45580/0 (socket says 172.21.15.52:45580) 2024-09-11T14:56:16.810 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.808+0000 7f2c8e19b640 1 -- 172.21.15.52:0/694804623 learned_addr learned my addr 172.21.15.52:0/694804623 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:16.810 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c8e19b640 1 -- 172.21.15.52:0/694804623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb10920 con 0xc1dd70 2024-09-11T14:56:16.810 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c8e19b640 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcac680 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c877fe640 1 -- 172.21.15.52:0/694804623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c78037610 con 0xc1dd70 2024-09-11T14:56:16.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c877fe640 1 -- 172.21.15.52:0/694804623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c7802daf0 con 0xc1dd70 2024-09-11T14:56:16.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c877fe640 1 -- 172.21.15.52:0/694804623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c78039580 con 0xc1dd70 2024-09-11T14:56:16.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb10380 con 0xc1dd70 2024-09-11T14:56:16.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.809+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0xcb4cc0 con 0xc1dd70 2024-09-11T14:56:16.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.810+0000 7f2c877fe640 1 -- 172.21.15.52:0/694804623 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2c78039780 con 0xc1dd70 2024-09-11T14:56:16.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.810+0000 7f2c877fe640 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2c7403d170 0x7f2c7403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.810+0000 7f2c877fe640 1 -- 172.21.15.52:0/694804623 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(710..710 src has 412..710) ==== 3819+0+0 (crc 0 0 0) 0x7f2c78032040 con 0xc1dd70 2024-09-11T14:56:16.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.811+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> v2:172.21.15.143:6803/3147275988 conn(0xcadec0 0xcb34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.811+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0xc99130 con 0xcadec0 2024-09-11T14:56:16.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.811+0000 7f2c8d99a640 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2c7403d170 0x7f2c7403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:16.813 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.811+0000 7f2c8d99a640 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2c7403d170 0x7f2c7403f680 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.813 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.812+0000 7f2c8e99c640 1 --2- 172.21.15.52:0/694804623 >> v2:172.21.15.143:6803/3147275988 conn(0xcadec0 0xcb34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:56:16.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.819+0000 7f2c8e99c640 1 --2- 172.21.15.52:0/694804623 >> v2:172.21.15.143:6803/3147275988 conn(0xcadec0 0xcb34e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c8e99c640 1 -- 172.21.15.52:0/694804623 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 twomore [writefull 0~12777] v710'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f2c8000a430 con 0xcadec0 2024-09-11T14:56:16.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 >> v2:172.21.15.143:6803/3147275988 conn(0xcadec0 msgr2=0xcb34e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> v2:172.21.15.143:6803/3147275988 conn(0xcadec0 0xcb34e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2c7403d170 msgr2=0x7f2c7403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2c7403d170 0x7f2c7403f680 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 msgr2=0xcac680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcac680 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 shutdown_connections 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> v2:172.21.15.143:6803/3147275988 conn(0xcadec0 0xcb34e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2c7403d170 0x7f2c7403f680 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 --2- 172.21.15.52:0/694804623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc1dd70 0xcac680 unknown :-1 s=CLOSED pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 >> 172.21.15.52:0/694804623 conn(0xb42770 msgr2=0xc1b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 shutdown_connections 2024-09-11T14:56:16.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.847+0000 7f2c96068ec0 1 -- 172.21.15.52:0/694804623 wait complete. 2024-09-11T14:56:16.851 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_bytes 100 2024-09-11T14:56:16.950 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.940+0000 7f7b70cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:16.951 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.950+0000 7f7b70cac640 1 Processor -- start 2024-09-11T14:56:16.951 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.950+0000 7f7b70cac640 1 -- start start 2024-09-11T14:56:16.953 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.952+0000 7f7b70cac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b6c136cd0 0x7f7b6c1390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.953 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.952+0000 7f7b70cac640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6c0748f0 con 0x7f7b6c133d80 2024-09-11T14:56:16.953 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.952+0000 7f7b70cac640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7b6c0a1110 con 0x7f7b6c136cd0 2024-09-11T14:56:16.953 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.952+0000 7f7b6a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7b6c133d80 0x7f7b6c134190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39092/0 (socket says 172.21.15.52:39092) 2024-09-11T14:56:16.953 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.952+0000 7f7b6a59c640 1 -- 172.21.15.52:0/343180765 learned_addr learned my addr 172.21.15.52:0/343180765 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:56:16.954 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.952+0000 7f7b69d9b640 1 --2- 172.21.15.52:0/343180765 >> v2:172.21.15.52:3300/0 conn(0x7f7b6c136cd0 0x7f7b6c1390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:16.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.953+0000 7f7b69d9b640 1 -- 172.21.15.52:0/343180765 >> v1:172.21.15.52:6789/0 conn(0x7f7b6c133d80 legacy=0x7f7b6c134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.953+0000 7f7b69d9b640 1 -- 172.21.15.52:0/343180765 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c09f5b0 con 0x7f7b6c136cd0 2024-09-11T14:56:16.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.953+0000 7f7b69d9b640 1 --2- 172.21.15.52:0/343180765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c136cd0 0x7f7b6c1390f0 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194e9aab89ded3af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.953+0000 7f7b6959a640 1 -- 172.21.15.52:0/343180765 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b60009d80 con 0x7f7b6c136cd0 2024-09-11T14:56:16.955 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.953+0000 7f7b6959a640 1 -- 172.21.15.52:0/343180765 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7b6000e230 con 0x7f7b6c136cd0 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.953+0000 7f7b6959a640 1 -- 172.21.15.52:0/343180765 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b6000e4d0 con 0x7f7b6c136cd0 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 -- 172.21.15.52:0/343180765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c136cd0 msgr2=0x7f7b6c1390f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 --2- 172.21.15.52:0/343180765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c136cd0 0x7f7b6c1390f0 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 -- 172.21.15.52:0/343180765 shutdown_connections 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 --2- 172.21.15.52:0/343180765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c136cd0 0x7f7b6c1390f0 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 -- 172.21.15.52:0/343180765 >> 172.21.15.52:0/343180765 conn(0x7f7b6c0a6d10 msgr2=0x7f7b6c073860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 -- 172.21.15.52:0/343180765 shutdown_connections 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 1 -- 172.21.15.52:0/343180765 wait complete. 2024-09-11T14:56:16.956 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.954+0000 7f7b70cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:16.957 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.956+0000 7f7b70cac640 1 Processor -- start 2024-09-11T14:56:16.957 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.956+0000 7f7b70cac640 1 -- start start 2024-09-11T14:56:16.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.957+0000 7f7b70cac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 0x7f7b6c1205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.957+0000 7f7b70cac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c122070 con 0x7f7b6c133d80 2024-09-11T14:56:16.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.957+0000 7f7b6a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 0x7f7b6c1205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:16.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.957+0000 7f7b6a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 0x7f7b6c1205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45598/0 (socket says 172.21.15.52:45598) 2024-09-11T14:56:16.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.957+0000 7f7b6a59c640 1 -- 172.21.15.52:0/2094507492 learned_addr learned my addr 172.21.15.52:0/2094507492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b6a59c640 1 -- 172.21.15.52:0/2094507492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c121830 con 0x7f7b6c133d80 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b6a59c640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 0x7f7b6c1205f0 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b5c005a60 con 0x7f7b6c133d80 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7b5c005bc0 con 0x7f7b6c133d80 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6c122920 con 0x7f7b6c133d80 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b5c005e60 con 0x7f7b6c133d80 2024-09-11T14:56:16.960 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.958+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6c1230a0 con 0x7f7b6c133d80 2024-09-11T14:56:16.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.959+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6c1244c0 con 0x7f7b6c133d80 2024-09-11T14:56:16.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.959+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7b5c00c7f0 con 0x7f7b6c133d80 2024-09-11T14:56:16.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.959+0000 7f7b5affd640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7b4c03e930 0x7f7b4c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:16.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.959+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(710..710 src has 412..710) ==== 3819+0+0 (crc 0 0 0) 0x7f7b5c04fb00 con 0x7f7b6c133d80 2024-09-11T14:56:16.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.960+0000 7f7b69d9b640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7b4c03e930 0x7f7b4c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:16.962 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.960+0000 7f7b69d9b640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7b4c03e930 0x7f7b4c040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:16.965 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:16.964+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f7b5c00dc10 con 0x7f7b6c133d80 2024-09-11T14:56:17.152 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:17.151+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "100"} v 0) -- 0x7f7b6c0a5cc0 con 0x7f7b6c133d80 2024-09-11T14:56:17.676 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:17.675+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v711) ==== 221+0+0 (crc 0 0 0) 0x7f7b5c00d610 con 0x7f7b6c133d80 2024-09-11T14:56:17.799 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:17.798+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "100"} v 0) -- 0x7f7b6c0008d0 con 0x7f7b6c133d80 2024-09-11T14:56:18.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.676+0000 7f7b5affd640 1 -- 172.21.15.52:0/2094507492 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v712) ==== 221+0+0 (crc 0 0 0) 0x7f7b5c00d7f0 con 0x7f7b6c133d80 2024-09-11T14:56:18.677 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_bytes = 100 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7b4c03e930 msgr2=0x7f7b4c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7b4c03e930 0x7f7b4c040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 msgr2=0x7f7b6c1205f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 0x7f7b6c1205f0 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 shutdown_connections 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7b4c03e930 0x7f7b4c040e40 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:18.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 --2- 172.21.15.52:0/2094507492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b6c133d80 0x7f7b6c1205f0 unknown :-1 s=CLOSED pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:18.683 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 >> 172.21.15.52:0/2094507492 conn(0x7f7b6c0a6d10 msgr2=0x7f7b6c072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:18.683 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 shutdown_connections 2024-09-11T14:56:18.683 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:18.681+0000 7f7b70cac640 1 -- 172.21.15.52:0/2094507492 wait complete. 2024-09-11T14:56:18.696 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 30 2024-09-11T14:56:48.699 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=95964 2024-09-11T14:56:48.699 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_bytes 0 2024-09-11T14:56:48.699 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put two /etc/passwd 2024-09-11T14:56:48.744 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.742+0000 7febbc4e9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:48.751 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.749+0000 7febbc4e9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:48.751 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.749+0000 7febbc4e9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:48.752 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.750+0000 7febbc4e9ec0 1 Processor -- start 2024-09-11T14:56:48.752 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.750+0000 7febbc4e9ec0 1 -- start start 2024-09-11T14:56:48.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febbc4e9ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc12190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febbc4e9ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xb77520 con 0xc0a8b0 2024-09-11T14:56:48.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febb483f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc12190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:48.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febb483f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc12190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48138/0 (socket says 172.21.15.52:48138) 2024-09-11T14:56:48.754 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febb483f640 1 -- 172.21.15.52:0/1302158305 learned_addr learned my addr 172.21.15.52:0/1302158305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:48.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febb483f640 1 -- 172.21.15.52:0/1302158305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb13e10 con 0xc0a8b0 2024-09-11T14:56:48.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.752+0000 7febb483f640 1 --2- 172.21.15.52:0/1302158305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc12190 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95244ca2aff53ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.753+0000 7febae7fc640 1 -- 172.21.15.52:0/1302158305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feba000b580 con 0xc0a8b0 2024-09-11T14:56:48.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.753+0000 7febae7fc640 1 -- 172.21.15.52:0/1302158305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feba000b6e0 con 0xc0a8b0 2024-09-11T14:56:48.755 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.753+0000 7febae7fc640 1 -- 172.21.15.52:0/1302158305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feba000b980 con 0xc0a8b0 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/1302158305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 msgr2=0xc12190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/1302158305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc12190 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/1302158305 shutdown_connections 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/1302158305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc12190 unknown :-1 s=CLOSED pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/1302158305 >> 172.21.15.52:0/1302158305 conn(0xb37770 msgr2=0xc15590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/1302158305 shutdown_connections 2024-09-11T14:56:48.756 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.754+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/1302158305 wait complete. 2024-09-11T14:56:48.757 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.755+0000 7febbc4e9ec0 1 Processor -- start 2024-09-11T14:56:48.757 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.755+0000 7febbc4e9ec0 1 -- start start 2024-09-11T14:56:48.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.757+0000 7febbc4e9ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc0f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.757+0000 7febbc4e9ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xb75280 con 0xc0a8b0 2024-09-11T14:56:48.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.757+0000 7febb483f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc0f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:48.759 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.757+0000 7febb483f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc0f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48148/0 (socket says 172.21.15.52:48148) 2024-09-11T14:56:48.760 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.757+0000 7febb483f640 1 -- 172.21.15.52:0/2238558703 learned_addr learned my addr 172.21.15.52:0/2238558703 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:48.760 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febb483f640 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb05920 con 0xc0a8b0 2024-09-11T14:56:48.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febb483f640 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc0f0b0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feba0012990 con 0xc0a8b0 2024-09-11T14:56:48.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feba0005040 con 0xc0a8b0 2024-09-11T14:56:48.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feba0012c20 con 0xc0a8b0 2024-09-11T14:56:48.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb05380 con 0xc0a8b0 2024-09-11T14:56:48.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.758+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc100e0 con 0xc0a8b0 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.759+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feba000d040 con 0xc0a8b0 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.760+0000 7febad7fa640 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb9c03d1c0 0x7feb9c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.760+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(713..713 src has 412..713) ==== 3819+0+0 (crc 0 0 0) 0x7feba000a040 con 0xc0a8b0 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.760+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7feb9c043450 con 0xc0a8b0 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> v2:172.21.15.143:6803/3147275988 conn(0xca7770 0xd3cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.760+0000 7febaf7fe640 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb9c03d1c0 0x7feb9c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:48.762 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.761+0000 7febaf7fe640 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb9c03d1c0 0x7feb9c03f6d0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.761+0000 7febb5040640 1 --2- 172.21.15.52:0/2238558703 >> v2:172.21.15.143:6803/3147275988 conn(0xca7770 0xd3cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:56:48.767 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.765+0000 7febb5040640 1 --2- 172.21.15.52:0/2238558703 >> v2:172.21.15.143:6803/3147275988 conn(0xca7770 0xd3cf80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.811 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.800+0000 7efc31f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:48.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.810+0000 7efc31f51640 1 Processor -- start 2024-09-11T14:56:48.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.810+0000 7efc31f51640 1 -- start start 2024-09-11T14:56:48.815 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc31f51640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc2c133d80 0x7efc2c134190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.815 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc31f51640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c0748f0 con 0x7efc2c09da20 2024-09-11T14:56:48.815 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc31f51640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efc2c0a1110 con 0x7efc2c133d80 2024-09-11T14:56:48.815 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc2c133d80 0x7efc2c134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:48.815 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc2c133d80 0x7efc2c134190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48154/0 (socket says 172.21.15.52:48154) 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2b7fe640 1 -- 172.21.15.52:0/2029084340 learned_addr learned my addr 172.21.15.52:0/2029084340 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2affd640 1 --1- 172.21.15.52:0/2029084340 >> v1:172.21.15.52:6789/0 conn(0x7efc2c09da20 0x7efc2c09de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56322/0 (socket says 172.21.15.52:56322) 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2b7fe640 1 -- 172.21.15.52:0/2029084340 >> v1:172.21.15.52:6789/0 conn(0x7efc2c09da20 legacy=0x7efc2c09de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2b7fe640 1 -- 172.21.15.52:0/2029084340 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c09f5b0 con 0x7efc2c133d80 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.812+0000 7efc2b7fe640 1 --2- 172.21.15.52:0/2029084340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c133d80 0x7efc2c134190 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d11442a3cf3d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc2a7fc640 1 -- 172.21.15.52:0/2029084340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc1c009e40 con 0x7efc2c133d80 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc2a7fc640 1 -- 172.21.15.52:0/2029084340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efc1c00e230 con 0x7efc2c133d80 2024-09-11T14:56:48.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc2a7fc640 1 -- 172.21.15.52:0/2029084340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc1c00e4d0 con 0x7efc2c133d80 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc31f51640 1 -- 172.21.15.52:0/2029084340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c133d80 msgr2=0x7efc2c134190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc31f51640 1 --2- 172.21.15.52:0/2029084340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c133d80 0x7efc2c134190 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc31f51640 1 -- 172.21.15.52:0/2029084340 shutdown_connections 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc31f51640 1 --2- 172.21.15.52:0/2029084340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c133d80 0x7efc2c134190 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc31f51640 1 -- 172.21.15.52:0/2029084340 >> 172.21.15.52:0/2029084340 conn(0x7efc2c0a6d10 msgr2=0x7efc2c073860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.813+0000 7efc31f51640 1 -- 172.21.15.52:0/2029084340 shutdown_connections 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.814+0000 7efc31f51640 1 -- 172.21.15.52:0/2029084340 wait complete. 2024-09-11T14:56:48.817 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.814+0000 7efc31f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:48.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.815+0000 7efc31f51640 1 Processor -- start 2024-09-11T14:56:48.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.816+0000 7efc31f51640 1 -- start start 2024-09-11T14:56:48.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.817+0000 7efc31f51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 0x7efc2c123ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.817+0000 7efc31f51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c1254f0 con 0x7efc2c09da20 2024-09-11T14:56:48.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.817+0000 7efc2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 0x7efc2c123ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.817+0000 7efc2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 0x7efc2c123ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48158/0 (socket says 172.21.15.52:48158) 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.817+0000 7efc2b7fe640 1 -- 172.21.15.52:0/2646902915 learned_addr learned my addr 172.21.15.52:0/2646902915 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc2b7fe640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c127220 con 0x7efc2c09da20 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc2b7fe640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 0x7efc2c123ba0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc1c00ede0 con 0x7efc2c09da20 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efc1c015420 con 0x7efc2c09da20 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c123770 con 0x7efc2c09da20 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc1c0156c0 con 0x7efc2c09da20 2024-09-11T14:56:48.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.818+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c0a49f0 con 0x7efc2c09da20 2024-09-11T14:56:48.822 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.819+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2c125630 con 0x7efc2c09da20 2024-09-11T14:56:48.822 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.819+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efc1c0158c0 con 0x7efc2c09da20 2024-09-11T14:56:48.822 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.819+0000 7efc13fff640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7efc1803e8e0 0x7efc18040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:48.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.819+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(713..713 src has 412..713) ==== 3819+0+0 (crc 0 0 0) 0x7efc1c051150 con 0x7efc2c09da20 2024-09-11T14:56:48.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.819+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7efc18044b70 con 0x7efc2c09da20 2024-09-11T14:56:48.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.820+0000 7efc2affd640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7efc1803e8e0 0x7efc18040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:48.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.820+0000 7efc2affd640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7efc1803e8e0 0x7efc18040df0 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:48.826 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:48.825+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7efc1c014c60 con 0x7efc2c09da20 2024-09-11T14:56:49.021 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.019+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"} v 0) -- 0x7efc2c0a5cc0 con 0x7efc2c09da20 2024-09-11T14:56:49.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.677+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v714) ==== 217+0+0 (crc 0 0 0) 0x7efc1c0059f0 con 0x7efc2c09da20 2024-09-11T14:56:49.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.678+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(714..714 src has 412..714) ==== 628+0+0 (crc 0 0 0) 0x7efc1c011e30 con 0x7efc2c09da20 2024-09-11T14:56:49.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.678+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 6 ==== osd_map(714..714 src has 412..714) ==== 628+0+0 (crc 0 0 0) 0x7feba000de10 con 0xc0a8b0 2024-09-11T14:56:49.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.678+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7efc18045ab0 con 0x7efc2c09da20 2024-09-11T14:56:49.680 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.678+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7feb9c043b90 con 0xc0a8b0 2024-09-11T14:56:49.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:49.801+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"} v 0) -- 0x7efc2c073ce0 con 0x7efc2c09da20 2024-09-11T14:56:50.681 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.678+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v715) ==== 217+0+0 (crc 0 0 0) 0x7efc1c0129e0 con 0x7efc2c09da20 2024-09-11T14:56:50.681 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_bytes = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:56:50.681 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.679+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 <== mon.0 v2:172.21.15.52:3300/0 10 ==== osd_map(715..715 src has 412..715) ==== 628+0+0 (crc 0 0 0) 0x7efc1c012d80 con 0x7efc2c09da20 2024-09-11T14:56:50.681 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.679+0000 7efc13fff640 1 -- 172.21.15.52:0/2646902915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7efc18045bd0 con 0x7efc2c09da20 2024-09-11T14:56:50.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.679+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 7 ==== osd_map(715..715 src has 412..715) ==== 628+0+0 (crc 0 0 0) 0x7feba0012dd0 con 0xc0a8b0 2024-09-11T14:56:50.682 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.679+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7feb9c043db0 con 0xc0a8b0 2024-09-11T14:56:50.684 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7efc1803e8e0 msgr2=0x7efc18040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:50.684 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7efc1803e8e0 0x7efc18040df0 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:50.684 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 msgr2=0x7efc2c123ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:50.684 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 0x7efc2c123ba0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:50.684 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 shutdown_connections 2024-09-11T14:56:50.684 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7efc1803e8e0 0x7efc18040df0 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:50.685 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 --2- 172.21.15.52:0/2646902915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc2c09da20 0x7efc2c123ba0 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:50.685 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 >> 172.21.15.52:0/2646902915 conn(0x7efc2c0a6d10 msgr2=0x7efc2c0a3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:50.685 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 shutdown_connections 2024-09-11T14:56:50.685 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.682+0000 7efc31f51640 1 -- 172.21.15.52:0/2646902915 wait complete. 2024-09-11T14:56:50.698 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_objects 0 2024-09-11T14:56:50.814 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.804+0000 7f9547674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:50.815 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.813+0000 7f9547674640 1 Processor -- start 2024-09-11T14:56:50.816 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.814+0000 7f9547674640 1 -- start start 2024-09-11T14:56:50.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.815+0000 7f9547674640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9540135cb0 0x7f95401380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:50.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.815+0000 7f9547674640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9540132940 con 0x7f9540132ba0 2024-09-11T14:56:50.818 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.815+0000 7f9547674640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f954006f7a0 con 0x7f9540135cb0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.815+0000 7f9545410640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9540132ba0 0x7f9540132fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56326/0 (socket says 172.21.15.52:56326) 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.815+0000 7f9545410640 1 -- 172.21.15.52:0/282326037 learned_addr learned my addr 172.21.15.52:0/282326037 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.815+0000 7f9544c0f640 1 --2- 172.21.15.52:0/282326037 >> v2:172.21.15.52:3300/0 conn(0x7f9540135cb0 0x7f95401380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9537fff640 1 -- 172.21.15.52:0/282326037 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151505863 0 0) 0x7f9540132940 con 0x7f9540132ba0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9537fff640 1 -- 172.21.15.52:0/282326037 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f952c003580 con 0x7f9540132ba0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9544c0f640 1 -- 172.21.15.52:0/282326037 >> v1:172.21.15.52:6789/0 conn(0x7f9540132ba0 legacy=0x7f9540132fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9544c0f640 1 -- 172.21.15.52:0/282326037 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954006ebc0 con 0x7f9540135cb0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9544c0f640 1 --2- 172.21.15.52:0/282326037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540135cb0 0x7f95401380d0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1f795cc835a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9537fff640 1 -- 172.21.15.52:0/282326037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9530009d90 con 0x7f9540135cb0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9537fff640 1 -- 172.21.15.52:0/282326037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f953000e230 con 0x7f9540135cb0 2024-09-11T14:56:50.819 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.816+0000 7f9537fff640 1 -- 172.21.15.52:0/282326037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f953000e4d0 con 0x7f9540135cb0 2024-09-11T14:56:50.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 -- 172.21.15.52:0/282326037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540135cb0 msgr2=0x7f95401380d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:50.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 --2- 172.21.15.52:0/282326037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540135cb0 0x7f95401380d0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:50.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 -- 172.21.15.52:0/282326037 shutdown_connections 2024-09-11T14:56:50.820 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 --2- 172.21.15.52:0/282326037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540135cb0 0x7f95401380d0 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:50.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 -- 172.21.15.52:0/282326037 >> 172.21.15.52:0/282326037 conn(0x7f95400a0f60 msgr2=0x7f95400a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:50.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 -- 172.21.15.52:0/282326037 shutdown_connections 2024-09-11T14:56:50.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 1 -- 172.21.15.52:0/282326037 wait complete. 2024-09-11T14:56:50.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.817+0000 7f9547674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:50.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.820+0000 7f9547674640 1 Processor -- start 2024-09-11T14:56:50.821 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.820+0000 7f9547674640 1 -- start start 2024-09-11T14:56:50.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9547674640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 0x7f954012e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9547674640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f954012cbc0 con 0x7f9540132ba0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9545410640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 0x7f954012e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9545410640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 0x7f954012e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48170/0 (socket says 172.21.15.52:48170) 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9545410640 1 -- 172.21.15.52:0/2853066648 learned_addr learned my addr 172.21.15.52:0/2853066648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9545410640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954012dc00 con 0x7f9540132ba0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9545410640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 0x7f954012e340 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f953c005a60 con 0x7f9540132ba0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f953c005bc0 con 0x7f9540132ba0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954012c960 con 0x7f9540132ba0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f953c005e60 con 0x7f9540132ba0 2024-09-11T14:56:50.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.822+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954012bb40 con 0x7f9540132ba0 2024-09-11T14:56:50.825 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.823+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954012c450 con 0x7f9540132ba0 2024-09-11T14:56:50.825 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.823+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f953c0070b0 con 0x7f9540132ba0 2024-09-11T14:56:50.825 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.823+0000 7f9535ffb640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f952403e930 0x7f9524040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:50.825 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.823+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(715..715 src has 412..715) ==== 3819+0+0 (crc 0 0 0) 0x7f953c04faa0 con 0x7f9540132ba0 2024-09-11T14:56:50.826 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.823+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7f9524044c20 con 0x7f9540132ba0 2024-09-11T14:56:50.826 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.823+0000 7f9544c0f640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f952403e930 0x7f9524040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:50.826 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.824+0000 7f9544c0f640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f952403e930 0x7f9524040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:50.830 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:50.829+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f954012c450 con 0x7f9540132ba0 2024-09-11T14:56:51.020 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.018+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"} v 0) -- 0x7f954012c450 con 0x7f9540132ba0 2024-09-11T14:56:51.676 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.674+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v716) ==== 221+0+0 (crc 0 0 0) 0x7f954012c450 con 0x7f9540132ba0 2024-09-11T14:56:51.676 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.674+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(716..716 src has 412..716) ==== 628+0+0 (crc 0 0 0) 0x7feba0013dc0 con 0xc0a8b0 2024-09-11T14:56:51.676 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.674+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7feb9c043fa0 con 0xc0a8b0 2024-09-11T14:56:51.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.674+0000 7febad7fa640 1 -- 172.21.15.52:0/2238558703 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x7feb9c044190 con 0xca7770 2024-09-11T14:56:51.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.674+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(716..716 src has 412..716) ==== 628+0+0 (crc 0 0 0) 0x7f953c00da00 con 0x7f9540132ba0 2024-09-11T14:56:51.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.674+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7f9524045c10 con 0x7f9540132ba0 2024-09-11T14:56:51.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febb5040640 1 -- 172.21.15.52:0/2238558703 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 two [writefull 0~12777] v716'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7feba800a430 con 0xca7770 2024-09-11T14:56:51.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 >> v2:172.21.15.143:6803/3147275988 conn(0xca7770 msgr2=0xd3cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:51.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> v2:172.21.15.143:6803/3147275988 conn(0xca7770 0xd3cf80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:51.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb9c03d1c0 msgr2=0x7feb9c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:51.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb9c03d1c0 0x7feb9c03f6d0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:51.763 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 msgr2=0xc0f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc0f0b0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 shutdown_connections 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> v2:172.21.15.143:6803/3147275988 conn(0xca7770 0xd3cf80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb9c03d1c0 0x7feb9c03f6d0 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 --2- 172.21.15.52:0/2238558703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xc0a8b0 0xc0f0b0 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 >> 172.21.15.52:0/2238558703 conn(0xb37770 msgr2=0xc15590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 shutdown_connections 2024-09-11T14:56:51.764 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.760+0000 7febbc4e9ec0 1 -- 172.21.15.52:0/2238558703 wait complete. 2024-09-11T14:56:51.822 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:51.821+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"} v 0) -- 0x7f954012c450 con 0x7f9540132ba0 2024-09-11T14:56:52.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.691+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v717) ==== 221+0+0 (crc 0 0 0) 0x7f954012c450 con 0x7f9540132ba0 2024-09-11T14:56:52.693 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_objects = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:56:52.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.692+0000 7f9535ffb640 1 -- 172.21.15.52:0/2853066648 <== mon.0 v2:172.21.15.52:3300/0 10 ==== osd_map(717..717 src has 412..717) ==== 628+0+0 (crc 0 0 0) 0x7f953c021cf0 con 0x7f9540132ba0 2024-09-11T14:56:52.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f952403e930 msgr2=0x7f9524040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f952403e930 0x7f9524040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 msgr2=0x7f954012e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 0x7f954012e340 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 shutdown_connections 2024-09-11T14:56:52.698 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f952403e930 0x7f9524040e40 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.698 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 --2- 172.21.15.52:0/2853066648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9540132ba0 0x7f954012e340 unknown :-1 s=CLOSED pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.698 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 >> 172.21.15.52:0/2853066648 conn(0x7f95400a0f60 msgr2=0x7f9540131450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:52.698 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 shutdown_connections 2024-09-11T14:56:52.698 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.696+0000 7f9547674640 1 -- 172.21.15.52:0/2853066648 wait complete. 2024-09-11T14:56:52.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 95964 2024-09-11T14:56:52.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T14:56:52.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ true 2024-09-11T14:56:52.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put three /etc/passwd 2024-09-11T14:56:52.761 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.760+0000 7f7243531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:52.767 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.766+0000 7f7243531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:52.767 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.766+0000 7f7243531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:52.768 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.767+0000 7f7243531ec0 1 Processor -- start 2024-09-11T14:56:52.768 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.767+0000 7f7243531ec0 1 -- start start 2024-09-11T14:56:52.770 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7243531ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x16a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.770 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7243531ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1579520 con 0x1614190 2024-09-11T14:56:52.770 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7236ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x16a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:52.770 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7236ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x16a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48190/0 (socket says 172.21.15.52:48190) 2024-09-11T14:56:52.771 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7236ffd640 1 -- 172.21.15.52:0/1485506281 learned_addr learned my addr 172.21.15.52:0/1485506281 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:52.771 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7236ffd640 1 -- 172.21.15.52:0/1485506281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1515e10 con 0x1614190 2024-09-11T14:56:52.771 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f7236ffd640 1 --2- 172.21.15.52:0/1485506281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x16a5a50 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb11b70ca3e2a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.771 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f72357fa640 1 -- 172.21.15.52:0/1485506281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f722800b580 con 0x1614190 2024-09-11T14:56:52.771 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f72357fa640 1 -- 172.21.15.52:0/1485506281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f722800b6e0 con 0x1614190 2024-09-11T14:56:52.771 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.769+0000 7f72357fa640 1 -- 172.21.15.52:0/1485506281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f722800b980 con 0x1614190 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 -- 172.21.15.52:0/1485506281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 msgr2=0x16a5a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1485506281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x16a5a50 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 -- 172.21.15.52:0/1485506281 shutdown_connections 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1485506281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x16a5a50 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 -- 172.21.15.52:0/1485506281 >> 172.21.15.52:0/1485506281 conn(0x1539770 msgr2=0x1610420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 -- 172.21.15.52:0/1485506281 shutdown_connections 2024-09-11T14:56:52.772 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.770+0000 7f7243531ec0 1 -- 172.21.15.52:0/1485506281 wait complete. 2024-09-11T14:56:52.773 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.771+0000 7f7243531ec0 1 Processor -- start 2024-09-11T14:56:52.773 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.771+0000 7f7243531ec0 1 -- start start 2024-09-11T14:56:52.774 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7243531ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x1734bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.774 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7243531ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1577280 con 0x1614190 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7236ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x1734bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7236ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x1734bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48198/0 (socket says 172.21.15.52:48198) 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7236ffd640 1 -- 172.21.15.52:0/1216635231 learned_addr learned my addr 172.21.15.52:0/1216635231 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7236ffd640 1 -- 172.21.15.52:0/1216635231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1507920 con 0x1614190 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7236ffd640 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x1734bb0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f721ffff640 1 -- 172.21.15.52:0/1216635231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7228012b10 con 0x1614190 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f721ffff640 1 -- 172.21.15.52:0/1216635231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7228005040 con 0x1614190 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1507380 con 0x1614190 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f721ffff640 1 -- 172.21.15.52:0/1216635231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7228012da0 con 0x1614190 2024-09-11T14:56:52.775 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.773+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1612150 con 0x1614190 2024-09-11T14:56:52.776 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.774+0000 7f721ffff640 1 -- 172.21.15.52:0/1216635231 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f722800d040 con 0x1614190 2024-09-11T14:56:52.776 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.775+0000 7f721ffff640 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f722403d1c0 0x7f722403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.776 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.775+0000 7f721ffff640 1 -- 172.21.15.52:0/1216635231 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(717..717 src has 412..717) ==== 3819+0+0 (crc 0 0 0) 0x7f722800a040 con 0x1614190 2024-09-11T14:56:52.777 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.775+0000 7f72367fc640 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f722403d1c0 0x7f722403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:52.777 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.775+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> v2:172.21.15.143:6803/3147275988 conn(0x1614cb0 0x1731790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.777 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.775+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e717) -- 0x1611a50 con 0x1614cb0 2024-09-11T14:56:52.777 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.776+0000 7f72367fc640 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f722403d1c0 0x7f722403f6d0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.777 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.776+0000 7f72377fe640 1 --2- 172.21.15.52:0/1216635231 >> v2:172.21.15.143:6803/3147275988 conn(0x1614cb0 0x1731790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:56:52.781 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.780+0000 7f72377fe640 1 --2- 172.21.15.52:0/1216635231 >> v2:172.21.15.143:6803/3147275988 conn(0x1614cb0 0x1731790 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f72377fe640 1 -- 172.21.15.52:0/1216635231 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 three [writefull 0~12777] v717'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f723000a430 con 0x1614cb0 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 >> v2:172.21.15.143:6803/3147275988 conn(0x1614cb0 msgr2=0x1731790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> v2:172.21.15.143:6803/3147275988 conn(0x1614cb0 0x1731790 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f722403d1c0 msgr2=0x7f722403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f722403d1c0 0x7f722403f6d0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 msgr2=0x1734bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x1734bb0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 shutdown_connections 2024-09-11T14:56:52.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> v2:172.21.15.143:6803/3147275988 conn(0x1614cb0 0x1731790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f722403d1c0 0x7f722403f6d0 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 --2- 172.21.15.52:0/1216635231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1614190 0x1734bb0 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 >> 172.21.15.52:0/1216635231 conn(0x1539770 msgr2=0x1616520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:52.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 shutdown_connections 2024-09-11T14:56:52.809 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.806+0000 7f7243531ec0 1 -- 172.21.15.52:0/1216635231 wait complete. 2024-09-11T14:56:52.810 INFO:tasks.workunit.client.0.smithi052.stderr:++ uuidgen 2024-09-11T14:56:52.811 INFO:tasks.workunit.client.0.smithi052.stderr:+ pp=96b90da5-7bb8-428c-a88c-95404cb5f515 2024-09-11T14:56:52.811 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool create 96b90da5-7bb8-428c-a88c-95404cb5f515 12 2024-09-11T14:56:52.908 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.899+0000 7f9a70191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:52.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.908+0000 7f9a70191640 1 Processor -- start 2024-09-11T14:56:52.909 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.908+0000 7f9a70191640 1 -- start start 2024-09-11T14:56:52.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a70191640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a6806f050 0x7f9a6813b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a70191640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a68074100 con 0x7f9a6806e530 2024-09-11T14:56:52.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a70191640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6809f4f0 con 0x7f9a6806f050 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a6d72c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a6806f050 0x7f9a6813b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a6d72c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a6806f050 0x7f9a6813b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48210/0 (socket says 172.21.15.52:48210) 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a6d72c640 1 -- 172.21.15.52:0/1505694044 learned_addr learned my addr 172.21.15.52:0/1505694044 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.909+0000 7f9a6df2d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a6806e530 0x7f9a6806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56344/0 (socket says 172.21.15.52:56344) 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.910+0000 7f9a6d72c640 1 -- 172.21.15.52:0/1505694044 >> v1:172.21.15.52:6789/0 conn(0x7f9a6806e530 legacy=0x7f9a6806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.910+0000 7f9a6d72c640 1 -- 172.21.15.52:0/1505694044 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6809d3e0 con 0x7f9a6806f050 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.910+0000 7f9a6d72c640 1 --2- 172.21.15.52:0/1505694044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806f050 0x7f9a6813b190 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabdf2bb4e213b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.910+0000 7f9a6cf2b640 1 -- 172.21.15.52:0/1505694044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a5c009e50 con 0x7f9a6806f050 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.910+0000 7f9a6cf2b640 1 -- 172.21.15.52:0/1505694044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a5c00e230 con 0x7f9a6806f050 2024-09-11T14:56:52.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.910+0000 7f9a6cf2b640 1 -- 172.21.15.52:0/1505694044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a5c00e4d0 con 0x7f9a6806f050 2024-09-11T14:56:52.913 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 -- 172.21.15.52:0/1505694044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806f050 msgr2=0x7f9a6813b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:52.913 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 --2- 172.21.15.52:0/1505694044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806f050 0x7f9a6813b190 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.913 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 -- 172.21.15.52:0/1505694044 shutdown_connections 2024-09-11T14:56:52.913 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 --2- 172.21.15.52:0/1505694044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806f050 0x7f9a6813b190 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:52.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 -- 172.21.15.52:0/1505694044 >> 172.21.15.52:0/1505694044 conn(0x7f9a680a2ee0 msgr2=0x7f9a680a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:52.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 -- 172.21.15.52:0/1505694044 shutdown_connections 2024-09-11T14:56:52.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 1 -- 172.21.15.52:0/1505694044 wait complete. 2024-09-11T14:56:52.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.911+0000 7f9a70191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:52.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.913+0000 7f9a70191640 1 Processor -- start 2024-09-11T14:56:52.914 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.913+0000 7f9a70191640 1 -- start start 2024-09-11T14:56:52.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.914+0000 7f9a70191640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 0x7f9a681cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.914+0000 7f9a70191640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681b8ed0 con 0x7f9a6806e530 2024-09-11T14:56:52.916 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a6df2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 0x7f9a681cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a6df2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 0x7f9a681cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48218/0 (socket says 172.21.15.52:48218) 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a6df2d640 1 -- 172.21.15.52:0/4149161740 learned_addr learned my addr 172.21.15.52:0/4149161740 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a6df2d640 1 -- 172.21.15.52:0/4149161740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a681b8450 con 0x7f9a6806e530 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a6df2d640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 0x7f9a681cb270 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a600059a0 con 0x7f9a6806e530 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a60005b00 con 0x7f9a6806e530 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a681ba5a0 con 0x7f9a6806e530 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a60005da0 con 0x7f9a6806e530 2024-09-11T14:56:52.917 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.915+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a681b8a60 con 0x7f9a6806e530 2024-09-11T14:56:52.918 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.916+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a681b8cb0 con 0x7f9a6806e530 2024-09-11T14:56:52.918 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.916+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9a600070b0 con 0x7f9a6806e530 2024-09-11T14:56:52.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.916+0000 7f9a667fc640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f9a5403e930 0x7f9a54040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:52.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.916+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(717..717 src has 412..717) ==== 3819+0+0 (crc 0 0 0) 0x7f9a6004fa70 con 0x7f9a6806e530 2024-09-11T14:56:52.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.917+0000 7f9a6d72c640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f9a5403e930 0x7f9a54040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:52.919 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.917+0000 7f9a6d72c640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f9a5403e930 0x7f9a54040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:52.922 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:52.922+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f9a6000f230 con 0x7f9a6806e530 2024-09-11T14:56:53.106 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.105+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pg_num": 12} v 0) -- 0x7f9a68074ac0 con 0x7f9a6806e530 2024-09-11T14:56:53.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.695+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pg_num": 12}]=0 pool '96b90da5-7bb8-428c-a88c-95404cb5f515' created v718) ==== 176+0+0 (crc 0 0 0) 0x7f9a6000d150 con 0x7f9a6806e530 2024-09-11T14:56:53.847 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.846+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pg_num": 12} v 0) -- 0x7f9a68074360 con 0x7f9a6806e530 2024-09-11T14:56:53.848 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.847+0000 7f9a667fc640 1 -- 172.21.15.52:0/4149161740 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pg_num": 12}]=0 pool '96b90da5-7bb8-428c-a88c-95404cb5f515' already exists v718) ==== 183+0+0 (crc 0 0 0) 0x7f9a6000d840 con 0x7f9a6806e530 2024-09-11T14:56:53.848 INFO:tasks.workunit.client.0.smithi052.stderr:pool '96b90da5-7bb8-428c-a88c-95404cb5f515' already exists 2024-09-11T14:56:53.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f9a5403e930 msgr2=0x7f9a54040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:53.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f9a5403e930 0x7f9a54040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:53.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 msgr2=0x7f9a681cb270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:53.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 0x7f9a681cb270 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:53.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 shutdown_connections 2024-09-11T14:56:53.852 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f9a5403e930 0x7f9a54040e40 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:53.852 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 --2- 172.21.15.52:0/4149161740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6806e530 0x7f9a681cb270 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:53.852 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 >> 172.21.15.52:0/4149161740 conn(0x7f9a680a2ee0 msgr2=0x7f9a6809f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:53.852 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 shutdown_connections 2024-09-11T14:56:53.852 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.850+0000 7f9a70191640 1 -- 172.21.15.52:0/4149161740 wait complete. 2024-09-11T14:56:53.864 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool application enable 96b90da5-7bb8-428c-a88c-95404cb5f515 rados 2024-09-11T14:56:53.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.958+0000 7feba1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:53.969 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.968+0000 7feba1551640 1 Processor -- start 2024-09-11T14:56:53.969 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.968+0000 7feba1551640 1 -- start start 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feba1551640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb9c09f870 0x7feb9c09fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feba1551640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9c074b50 con 0x7feb9c0a01c0 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feba1551640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7feb9c0a0c60 con 0x7feb9c09f870 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feb9affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb9c09f870 0x7feb9c09fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feb9a7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feb9c0a01c0 0x7feb9c1364c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34308/0 (socket says 172.21.15.52:34308) 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feb9affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb9c09f870 0x7feb9c09fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48308/0 (socket says 172.21.15.52:48308) 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feb9a7fc640 1 -- 172.21.15.52:0/1386115047 learned_addr learned my addr 172.21.15.52:0/1386115047 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feb9affd640 1 -- 172.21.15.52:0/1386115047 >> v1:172.21.15.52:6789/0 conn(0x7feb9c0a01c0 legacy=0x7feb9c1364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.970+0000 7feb9affd640 1 -- 172.21.15.52:0/1386115047 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c0a2110 con 0x7feb9c09f870 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.971+0000 7feb9affd640 1 --2- 172.21.15.52:0/1386115047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c09fc80 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c698073933a8a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:53.972 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.971+0000 7feb99ffb640 1 -- 172.21.15.52:0/1386115047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb8c009d80 con 0x7feb9c09f870 2024-09-11T14:56:53.973 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.971+0000 7feb99ffb640 1 -- 172.21.15.52:0/1386115047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb8c00e230 con 0x7feb9c09f870 2024-09-11T14:56:53.973 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.971+0000 7feb99ffb640 1 -- 172.21.15.52:0/1386115047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb8c00e4d0 con 0x7feb9c09f870 2024-09-11T14:56:53.973 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 -- 172.21.15.52:0/1386115047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 msgr2=0x7feb9c09fc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 --2- 172.21.15.52:0/1386115047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c09fc80 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 -- 172.21.15.52:0/1386115047 shutdown_connections 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 --2- 172.21.15.52:0/1386115047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c09fc80 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 -- 172.21.15.52:0/1386115047 >> 172.21.15.52:0/1386115047 conn(0x7feb9c0a6270 msgr2=0x7feb9c0a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 -- 172.21.15.52:0/1386115047 shutdown_connections 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 1 -- 172.21.15.52:0/1386115047 wait complete. 2024-09-11T14:56:53.974 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.972+0000 7feba1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:53.975 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.974+0000 7feba1551640 1 Processor -- start 2024-09-11T14:56:53.975 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.974+0000 7feba1551640 1 -- start start 2024-09-11T14:56:53.977 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.975+0000 7feba1551640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:53.977 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.975+0000 7feba1551640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c137060 con 0x7feb9c09f870 2024-09-11T14:56:53.977 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb9affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:53.977 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb9affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c133740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48318/0 (socket says 172.21.15.52:48318) 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb9affd640 1 -- 172.21.15.52:0/2478597052 learned_addr learned my addr 172.21.15.52:0/2478597052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb9affd640 1 -- 172.21.15.52:0/2478597052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c06f4e0 con 0x7feb9c09f870 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb9affd640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c133740 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb8c013530 con 0x7feb9c09f870 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb8c013690 con 0x7feb9c09f870 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c1374c0 con 0x7feb9c09f870 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb8c013930 con 0x7feb9c09f870 2024-09-11T14:56:53.978 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.976+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c09f300 con 0x7feb9c09f870 2024-09-11T14:56:53.979 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.977+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c134ef0 con 0x7feb9c09f870 2024-09-11T14:56:53.979 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.977+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feb8c013b30 con 0x7feb9c09f870 2024-09-11T14:56:53.979 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.978+0000 7feb837fe640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb8803e910 0x7feb88040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:53.979 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.978+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(718..718 src has 412..718) ==== 4194+0+0 (crc 0 0 0) 0x7feb8c018040 con 0x7feb9c09f870 2024-09-11T14:56:53.979 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.978+0000 7feb9a7fc640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb8803e910 0x7feb88040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:53.979 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.979+0000 7feb9a7fc640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb8803e910 0x7feb88040e20 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:53.984 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:53.983+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7feb8c012ca0 con 0x7feb9c09f870 2024-09-11T14:56:54.173 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:54.172+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "app": "rados"} v 0) -- 0x7feb9c06f4e0 con 0x7feb9c09f870 2024-09-11T14:56:54.698 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:54.696+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "app": "rados"}]=0 enabled application 'rados' on pool '96b90da5-7bb8-428c-a88c-95404cb5f515' v719) ==== 213+0+0 (crc 0 0 0) 0x7feb9c06f4e0 con 0x7feb9c09f870 2024-09-11T14:56:54.886 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:54.885+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "app": "rados"} v 0) -- 0x7feb9c06f4e0 con 0x7feb9c09f870 2024-09-11T14:56:55.705 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.703+0000 7feb837fe640 1 -- 172.21.15.52:0/2478597052 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "app": "rados"}]=0 enabled application 'rados' on pool '96b90da5-7bb8-428c-a88c-95404cb5f515' v720) ==== 213+0+0 (crc 0 0 0) 0x7feb9c06f4e0 con 0x7feb9c09f870 2024-09-11T14:56:55.705 INFO:tasks.workunit.client.0.smithi052.stderr:enabled application 'rados' on pool '96b90da5-7bb8-428c-a88c-95404cb5f515' 2024-09-11T14:56:55.709 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb8803e910 msgr2=0x7feb88040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:55.709 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb8803e910 0x7feb88040e20 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:55.709 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 msgr2=0x7feb9c133740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c133740 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 shutdown_connections 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7feb8803e910 0x7feb88040e20 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 --2- 172.21.15.52:0/2478597052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c09f870 0x7feb9c133740 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 >> 172.21.15.52:0/2478597052 conn(0x7feb9c0a6270 msgr2=0x7feb9c0726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 shutdown_connections 2024-09-11T14:56:55.710 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.708+0000 7feba1551640 1 -- 172.21.15.52:0/2478597052 wait complete. 2024-09-11T14:56:55.726 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 96b90da5-7bb8-428c-a88c-95404cb5f515 max_objects 10 2024-09-11T14:56:55.839 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.829+0000 7f4c35791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:55.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.839+0000 7f4c35791640 1 Processor -- start 2024-09-11T14:56:55.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.839+0000 7f4c35791640 1 -- start start 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c35791640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c30136cd0 0x7f4c301390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c35791640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c300748f0 con 0x7f4c30133d80 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c35791640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4c300a1110 con 0x7f4c30136cd0 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c30136cd0 0x7f4c301390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c30136cd0 0x7f4c301390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48322/0 (socket says 172.21.15.52:48322) 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2e7fc640 1 -- 172.21.15.52:0/3872291783 learned_addr learned my addr 172.21.15.52:0/3872291783 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2effd640 1 --1- 172.21.15.52:0/3872291783 >> v1:172.21.15.52:6789/0 conn(0x7f4c30133d80 0x7f4c30134190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34314/0 (socket says 172.21.15.52:34314) 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2e7fc640 1 -- 172.21.15.52:0/3872291783 >> v1:172.21.15.52:6789/0 conn(0x7f4c30133d80 legacy=0x7f4c30134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2e7fc640 1 -- 172.21.15.52:0/3872291783 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3009f5b0 con 0x7f4c30136cd0 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.841+0000 7f4c2dffb640 1 -- 172.21.15.52:0/3872291783 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064775017 0 0) 0x7f4c300748f0 con 0x7f4c30133d80 2024-09-11T14:56:55.843 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.842+0000 7f4c2e7fc640 1 --2- 172.21.15.52:0/3872291783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30136cd0 0x7f4c301390f0 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9625bc18b62b8fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:55.844 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.842+0000 7f4c2dffb640 1 -- 172.21.15.52:0/3872291783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c24009e40 con 0x7f4c30136cd0 2024-09-11T14:56:55.844 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.842+0000 7f4c2dffb640 1 -- 172.21.15.52:0/3872291783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c2400e230 con 0x7f4c30136cd0 2024-09-11T14:56:55.844 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.842+0000 7f4c2dffb640 1 -- 172.21.15.52:0/3872291783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c2400e4d0 con 0x7f4c30136cd0 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.842+0000 7f4c35791640 1 -- 172.21.15.52:0/3872291783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30136cd0 msgr2=0x7f4c301390f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.842+0000 7f4c35791640 1 --2- 172.21.15.52:0/3872291783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30136cd0 0x7f4c301390f0 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.843+0000 7f4c35791640 1 -- 172.21.15.52:0/3872291783 shutdown_connections 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.843+0000 7f4c35791640 1 --2- 172.21.15.52:0/3872291783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30136cd0 0x7f4c301390f0 unknown :-1 s=CLOSED pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.843+0000 7f4c35791640 1 -- 172.21.15.52:0/3872291783 >> 172.21.15.52:0/3872291783 conn(0x7f4c300a6d10 msgr2=0x7f4c30073860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.843+0000 7f4c35791640 1 -- 172.21.15.52:0/3872291783 shutdown_connections 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.843+0000 7f4c35791640 1 -- 172.21.15.52:0/3872291783 wait complete. 2024-09-11T14:56:55.845 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.843+0000 7f4c35791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:56:55.846 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.845+0000 7f4c35791640 1 Processor -- start 2024-09-11T14:56:55.846 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.845+0000 7f4c35791640 1 -- start start 2024-09-11T14:56:55.848 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.846+0000 7f4c35791640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 0x7f4c301209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:55.848 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.846+0000 7f4c35791640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3009e3c0 con 0x7f4c30133d80 2024-09-11T14:56:55.848 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.846+0000 7f4c2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 0x7f4c301209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.846+0000 7f4c2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 0x7f4c301209e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48336/0 (socket says 172.21.15.52:48336) 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c2effd640 1 -- 172.21.15.52:0/605702303 learned_addr learned my addr 172.21.15.52:0/605702303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c2effd640 1 -- 172.21.15.52:0/605702303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c301248d0 con 0x7f4c30133d80 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c2effd640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 0x7f4c301209e0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c20004b80 con 0x7f4c30133d80 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c20004ce0 con 0x7f4c30133d80 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c30123bf0 con 0x7f4c30133d80 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c20007120 con 0x7f4c30133d80 2024-09-11T14:56:55.849 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.847+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c301238e0 con 0x7f4c30133d80 2024-09-11T14:56:55.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.848+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c300a5cc0 con 0x7f4c30133d80 2024-09-11T14:56:55.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.848+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4c200072d0 con 0x7f4c30133d80 2024-09-11T14:56:55.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.849+0000 7f4c177fe640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4c1c03e930 0x7f4c1c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:56:55.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.849+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(720..720 src has 412..720) ==== 4207+0+0 (crc 0 0 0) 0x7f4c2004fd50 con 0x7f4c30133d80 2024-09-11T14:56:55.850 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.849+0000 7f4c2e7fc640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4c1c03e930 0x7f4c1c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:56:55.851 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.849+0000 7f4c2e7fc640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4c1c03e930 0x7f4c1c040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:56:55.855 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:55.854+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4c2000f230 con 0x7f4c30133d80 2024-09-11T14:56:56.044 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:56.043+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "field": "max_objects", "val": "10"} v 0) -- 0x7f4c3009e840 con 0x7f4c30133d80 2024-09-11T14:56:56.677 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:56.676+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 96b90da5-7bb8-428c-a88c-95404cb5f515 v721) ==== 223+0+0 (crc 0 0 0) 0x7f4c20006740 con 0x7f4c30133d80 2024-09-11T14:56:56.802 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:56.801+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "field": "max_objects", "val": "10"} v 0) -- 0x7f4c300008d0 con 0x7f4c30133d80 2024-09-11T14:56:57.709 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.708+0000 7f4c177fe640 1 -- 172.21.15.52:0/605702303 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 96b90da5-7bb8-428c-a88c-95404cb5f515 v722) ==== 223+0+0 (crc 0 0 0) 0x7f4c2000a0c0 con 0x7f4c30133d80 2024-09-11T14:56:57.709 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_objects = 10 for pool 96b90da5-7bb8-428c-a88c-95404cb5f515 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4c1c03e930 msgr2=0x7f4c1c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4c1c03e930 0x7f4c1c040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 msgr2=0x7f4c301209e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 0x7f4c301209e0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 shutdown_connections 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f4c1c03e930 0x7f4c1c040e40 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 --2- 172.21.15.52:0/605702303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c30133d80 0x7f4c301209e0 crc :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.711+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 >> 172.21.15.52:0/605702303 conn(0x7f4c300a6d10 msgr2=0x7f4c30072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.712+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 shutdown_connections 2024-09-11T14:56:57.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:56:57.712+0000 7f4c35791640 1 -- 172.21.15.52:0/605702303 wait complete. 2024-09-11T14:56:57.727 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 30 2024-09-11T14:57:27.729 INFO:tasks.workunit.client.0.smithi052.stderr:++ seq 1 10 2024-09-11T14:57:27.730 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:27.730 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj1 /etc/passwd 2024-09-11T14:57:27.773 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.772+0000 7f3379443ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.780 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.779+0000 7f3379443ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.780 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.779+0000 7f3379443ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.781 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.780+0000 7f3379443ec0 1 Processor -- start 2024-09-11T14:57:27.781 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.780+0000 7f3379443ec0 1 -- start start 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.781+0000 7f3379443ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x155b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.781+0000 7f3379443ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x14d9520 con 0x16067f0 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.781+0000 7f337159b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x155b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.781+0000 7f337159b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x155b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51764/0 (socket says 172.21.15.52:51764) 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.781+0000 7f337159b640 1 -- 172.21.15.52:0/3603264451 learned_addr learned my addr 172.21.15.52:0/3603264451 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.782+0000 7f337159b640 1 -- 172.21.15.52:0/3603264451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1475e10 con 0x16067f0 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.782+0000 7f337159b640 1 --2- 172.21.15.52:0/3603264451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x155b400 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eda28e90e2a015 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.782+0000 7f336b7fe640 1 -- 172.21.15.52:0/3603264451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f335c02dbe0 con 0x16067f0 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.782+0000 7f336b7fe640 1 -- 172.21.15.52:0/3603264451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f335c037370 con 0x16067f0 2024-09-11T14:57:27.783 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.782+0000 7f336b7fe640 1 -- 172.21.15.52:0/3603264451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f335c037610 con 0x16067f0 2024-09-11T14:57:27.784 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 -- 172.21.15.52:0/3603264451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 msgr2=0x155b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.784 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 --2- 172.21.15.52:0/3603264451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x155b400 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.784 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 -- 172.21.15.52:0/3603264451 shutdown_connections 2024-09-11T14:57:27.785 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 --2- 172.21.15.52:0/3603264451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x155b400 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.785 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 -- 172.21.15.52:0/3603264451 >> 172.21.15.52:0/3603264451 conn(0x1499770 msgr2=0x156e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:27.785 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 -- 172.21.15.52:0/3603264451 shutdown_connections 2024-09-11T14:57:27.785 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.783+0000 7f3379443ec0 1 -- 172.21.15.52:0/3603264451 wait complete. 2024-09-11T14:57:27.785 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.784+0000 7f3379443ec0 1 Processor -- start 2024-09-11T14:57:27.785 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.784+0000 7f3379443ec0 1 -- start start 2024-09-11T14:57:27.787 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.785+0000 7f3379443ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x168d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.787 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.785+0000 7f3379443ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x14d7280 con 0x16067f0 2024-09-11T14:57:27.787 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.785+0000 7f337159b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x168d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.787 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.785+0000 7f337159b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x168d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51770/0 (socket says 172.21.15.52:51770) 2024-09-11T14:57:27.787 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.785+0000 7f337159b640 1 -- 172.21.15.52:0/1345280127 learned_addr learned my addr 172.21.15.52:0/1345280127 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f337159b640 1 -- 172.21.15.52:0/1345280127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1467920 con 0x16067f0 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f337159b640 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x168d730 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f336a7fc640 1 -- 172.21.15.52:0/1345280127 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f335c02dbe0 con 0x16067f0 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f336a7fc640 1 -- 172.21.15.52:0/1345280127 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f335c039450 con 0x16067f0 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1467380 con 0x16067f0 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f336a7fc640 1 -- 172.21.15.52:0/1345280127 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f335c0396f0 con 0x16067f0 2024-09-11T14:57:27.788 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.786+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15f8d80 con 0x16067f0 2024-09-11T14:57:27.789 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.787+0000 7f336a7fc640 1 -- 172.21.15.52:0/1345280127 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f335c0398a0 con 0x16067f0 2024-09-11T14:57:27.789 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.788+0000 7f336a7fc640 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f335803d1c0 0x7f335803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.789 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.788+0000 7f336a7fc640 1 -- 172.21.15.52:0/1345280127 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f335c032040 con 0x16067f0 2024-09-11T14:57:27.789 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.788+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> v2:172.21.15.143:6803/3147275988 conn(0x1607140 0x169e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.789 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.788+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x15f8860 con 0x1607140 2024-09-11T14:57:27.789 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.788+0000 7f3370d9a640 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f335803d1c0 0x7f335803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.790 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.789+0000 7f3370d9a640 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f335803d1c0 0x7f335803f6d0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.790 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.790+0000 7f3371d9c640 1 --2- 172.21.15.52:0/1345280127 >> v2:172.21.15.143:6803/3147275988 conn(0x1607140 0x169e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:27.795 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.794+0000 7f3371d9c640 1 --2- 172.21.15.52:0/1345280127 >> v2:172.21.15.143:6803/3147275988 conn(0x1607140 0x169e840 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3371d9c640 1 -- 172.21.15.52:0/1345280127 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj1 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f336400a430 con 0x1607140 2024-09-11T14:57:27.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 >> v2:172.21.15.143:6803/3147275988 conn(0x1607140 msgr2=0x169e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> v2:172.21.15.143:6803/3147275988 conn(0x1607140 0x169e840 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f335803d1c0 msgr2=0x7f335803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f335803d1c0 0x7f335803f6d0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.823 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 msgr2=0x168d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.821+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x168d730 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 shutdown_connections 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> v2:172.21.15.143:6803/3147275988 conn(0x1607140 0x169e840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f335803d1c0 0x7f335803f6d0 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 --2- 172.21.15.52:0/1345280127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x16067f0 0x168d730 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 >> 172.21.15.52:0/1345280127 conn(0x1499770 msgr2=0x156e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 shutdown_connections 2024-09-11T14:57:27.824 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.822+0000 7f3379443ec0 1 -- 172.21.15.52:0/1345280127 wait complete. 2024-09-11T14:57:27.825 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:27.825 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj2 /etc/passwd 2024-09-11T14:57:27.866 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.865+0000 7f5802d0dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.873 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.871+0000 7f5802d0dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.874 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.871+0000 7f5802d0dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.874 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.872+0000 7f5802d0dec0 1 Processor -- start 2024-09-11T14:57:27.874 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.872+0000 7f5802d0dec0 1 -- start start 2024-09-11T14:57:27.875 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f5802d0dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.875 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f5802d0dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x12ae520 con 0x13db7f0 2024-09-11T14:57:27.875 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57fb63f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.875 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57fb63f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51788/0 (socket says 172.21.15.52:51788) 2024-09-11T14:57:27.876 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57fb63f640 1 -- 172.21.15.52:0/2218471410 learned_addr learned my addr 172.21.15.52:0/2218471410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:27.876 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57fb63f640 1 -- 172.21.15.52:0/2218471410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x124ae10 con 0x13db7f0 2024-09-11T14:57:27.876 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57fb63f640 1 --2- 172.21.15.52:0/2218471410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c5690 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cd3c97d5565569 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.876 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57f9e3c640 1 -- 172.21.15.52:0/2218471410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e40081f0 con 0x13db7f0 2024-09-11T14:57:27.876 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57f9e3c640 1 -- 172.21.15.52:0/2218471410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57e4008350 con 0x13db7f0 2024-09-11T14:57:27.876 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.874+0000 7f57f9e3c640 1 -- 172.21.15.52:0/2218471410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e4001b90 con 0x13db7f0 2024-09-11T14:57:27.877 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2218471410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 msgr2=0x13c5690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2218471410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c5690 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2218471410 shutdown_connections 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2218471410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c5690 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2218471410 >> 172.21.15.52:0/2218471410 conn(0x126e770 msgr2=0x13303e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2218471410 shutdown_connections 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.875+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2218471410 wait complete. 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.876+0000 7f5802d0dec0 1 Processor -- start 2024-09-11T14:57:27.878 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.876+0000 7f5802d0dec0 1 -- start start 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f5802d0dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f5802d0dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x12ac280 con 0x13db7f0 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57fb63f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57fb63f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51800/0 (socket says 172.21.15.52:51800) 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57fb63f640 1 -- 172.21.15.52:0/2195391905 learned_addr learned my addr 172.21.15.52:0/2195391905 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57fb63f640 1 -- 172.21.15.52:0/2195391905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x123c920 con 0x13db7f0 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57fb63f640 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c89b0 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57f8e3a640 1 -- 172.21.15.52:0/2195391905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e4007ea0 con 0x13db7f0 2024-09-11T14:57:27.880 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57f8e3a640 1 -- 172.21.15.52:0/2195391905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57e4008000 con 0x13db7f0 2024-09-11T14:57:27.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x123c380 con 0x13db7f0 2024-09-11T14:57:27.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f57f8e3a640 1 -- 172.21.15.52:0/2195391905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e4005660 con 0x13db7f0 2024-09-11T14:57:27.881 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.878+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x13cc480 con 0x13db7f0 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.879+0000 7f57f8e3a640 1 -- 172.21.15.52:0/2195391905 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f57e4005810 con 0x13db7f0 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.880+0000 7f57f8e3a640 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f57e003d1c0 0x7f57e003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.880+0000 7f57f8e3a640 1 -- 172.21.15.52:0/2195391905 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f57e4051fa0 con 0x13db7f0 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.880+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> v2:172.21.15.143:6803/3147275988 conn(0x13dc310 0x1873830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.880+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x13cbae0 con 0x13dc310 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.880+0000 7f57fae3e640 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f57e003d1c0 0x7f57e003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.882 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.881+0000 7f57fae3e640 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f57e003d1c0 0x7f57e003f6d0 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.883 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.881+0000 7f57fbe40640 1 --2- 172.21.15.52:0/2195391905 >> v2:172.21.15.143:6803/3147275988 conn(0x13dc310 0x1873830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:27.885 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.884+0000 7f57fbe40640 1 --2- 172.21.15.52:0/2195391905 >> v2:172.21.15.143:6803/3147275988 conn(0x13dc310 0x1873830 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f57fbe40640 1 -- 172.21.15.52:0/2195391905 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj2 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f57ec00c430 con 0x13dc310 2024-09-11T14:57:27.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 >> v2:172.21.15.143:6803/3147275988 conn(0x13dc310 msgr2=0x1873830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> v2:172.21.15.143:6803/3147275988 conn(0x13dc310 0x1873830 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f57e003d1c0 msgr2=0x7f57e003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f57e003d1c0 0x7f57e003f6d0 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.911 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 msgr2=0x13c89b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c89b0 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 shutdown_connections 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> v2:172.21.15.143:6803/3147275988 conn(0x13dc310 0x1873830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f57e003d1c0 0x7f57e003f6d0 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 --2- 172.21.15.52:0/2195391905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x13db7f0 0x13c89b0 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 >> 172.21.15.52:0/2195391905 conn(0x126e770 msgr2=0x13303e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 shutdown_connections 2024-09-11T14:57:27.912 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.909+0000 7f5802d0dec0 1 -- 172.21.15.52:0/2195391905 wait complete. 2024-09-11T14:57:27.913 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:27.913 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj3 /etc/passwd 2024-09-11T14:57:27.952 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.951+0000 7f4299e2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.958 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.957+0000 7f4299e2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.958 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.957+0000 7f4299e2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:27.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.958+0000 7f4299e2dec0 1 Processor -- start 2024-09-11T14:57:27.959 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.958+0000 7f4299e2dec0 1 -- start start 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.959+0000 7f4299e2dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xf38950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.959+0000 7f4299e2dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xd82520 con 0xe1e150 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.959+0000 7f4291e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xf38950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.959+0000 7f4291e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xf38950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51820/0 (socket says 172.21.15.52:51820) 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.959+0000 7f4291e3f640 1 -- 172.21.15.52:0/3813791212 learned_addr learned my addr 172.21.15.52:0/3813791212 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.959+0000 7f4291e3f640 1 -- 172.21.15.52:0/3813791212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd1ee10 con 0xe1e150 2024-09-11T14:57:27.961 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4291e3f640 1 --2- 172.21.15.52:0/3813791212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xf38950 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d8972c1df9e9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.962 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f428bfff640 1 -- 172.21.15.52:0/3813791212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f427c00b4a0 con 0xe1e150 2024-09-11T14:57:27.962 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f428bfff640 1 -- 172.21.15.52:0/3813791212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f427c008040 con 0xe1e150 2024-09-11T14:57:27.962 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f428bfff640 1 -- 172.21.15.52:0/3813791212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f427c00b730 con 0xe1e150 2024-09-11T14:57:27.963 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 -- 172.21.15.52:0/3813791212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 msgr2=0xf38950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.963 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/3813791212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xf38950 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.963 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 -- 172.21.15.52:0/3813791212 shutdown_connections 2024-09-11T14:57:27.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/3813791212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xf38950 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 -- 172.21.15.52:0/3813791212 >> 172.21.15.52:0/3813791212 conn(0xd42770 msgr2=0xe1ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:27.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 -- 172.21.15.52:0/3813791212 shutdown_connections 2024-09-11T14:57:27.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.960+0000 7f4299e2dec0 1 -- 172.21.15.52:0/3813791212 wait complete. 2024-09-11T14:57:27.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.961+0000 7f4299e2dec0 1 Processor -- start 2024-09-11T14:57:27.964 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.962+0000 7f4299e2dec0 1 -- start start 2024-09-11T14:57:27.965 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.963+0000 7f4299e2dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xe9bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.965 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.963+0000 7f4299e2dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xd80280 con 0xe1e150 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.963+0000 7f4291e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xe9bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.963+0000 7f4291e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xe9bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51836/0 (socket says 172.21.15.52:51836) 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.963+0000 7f4291e3f640 1 -- 172.21.15.52:0/1085391892 learned_addr learned my addr 172.21.15.52:0/1085391892 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.963+0000 7f4291e3f640 1 -- 172.21.15.52:0/1085391892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd10920 con 0xe1e150 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.964+0000 7f4291e3f640 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xe9bed0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.964+0000 7f428affd640 1 -- 172.21.15.52:0/1085391892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f427c012770 con 0xe1e150 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.964+0000 7f428affd640 1 -- 172.21.15.52:0/1085391892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f427c0128d0 con 0xe1e150 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.964+0000 7f428affd640 1 -- 172.21.15.52:0/1085391892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f427c012b70 con 0xe1e150 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.964+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd10380 con 0xe1e150 2024-09-11T14:57:27.966 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.964+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe9e0f0 con 0xe1e150 2024-09-11T14:57:27.967 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.965+0000 7f428affd640 1 -- 172.21.15.52:0/1085391892 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f427c012d20 con 0xe1e150 2024-09-11T14:57:27.967 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.965+0000 7f428affd640 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f427803d1c0 0x7f427803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.965+0000 7f428affd640 1 -- 172.21.15.52:0/1085391892 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f427c018040 con 0xe1e150 2024-09-11T14:57:27.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.966+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> v2:172.21.15.52:6802/4284075780 conn(0xe1ecd0 0xeaf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:27.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.966+0000 7f429163e640 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f427803d1c0 0x7f427803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:27.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.966+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0xeb04a0 con 0xe1ecd0 2024-09-11T14:57:27.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.966+0000 7f429163e640 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f427803d1c0 0x7f427803f6d0 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.968 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.967+0000 7f4292640640 1 --2- 172.21.15.52:0/1085391892 >> v2:172.21.15.52:6802/4284075780 conn(0xe1ecd0 0xeaf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:27.971 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.970+0000 7f4292640640 1 --2- 172.21.15.52:0/1085391892 >> v2:172.21.15.52:6802/4284075780 conn(0xe1ecd0 0xeaf3c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4292640640 1 -- 172.21.15.52:0/1085391892 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== osd_op_reply(1 obj3 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f428400a430 con 0xe1ecd0 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 >> v2:172.21.15.52:6802/4284075780 conn(0xe1ecd0 msgr2=0xeaf3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> v2:172.21.15.52:6802/4284075780 conn(0xe1ecd0 0xeaf3c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f427803d1c0 msgr2=0x7f427803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f427803d1c0 0x7f427803f6d0 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 msgr2=0xe9bed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:27.995 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xe9bed0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 shutdown_connections 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> v2:172.21.15.52:6802/4284075780 conn(0xe1ecd0 0xeaf3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f427803d1c0 0x7f427803f6d0 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 --2- 172.21.15.52:0/1085391892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0xe1e150 0xe9bed0 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 >> 172.21.15.52:0/1085391892 conn(0xd42770 msgr2=0xe21d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 shutdown_connections 2024-09-11T14:57:27.996 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:27.993+0000 7f4299e2dec0 1 -- 172.21.15.52:0/1085391892 wait complete. 2024-09-11T14:57:27.997 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:27.997 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj4 /etc/passwd 2024-09-11T14:57:28.035 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.034+0000 7f0bcc6f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.041 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.040+0000 7f0bcc6f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.041 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.040+0000 7f0bcc6f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.041 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.040+0000 7f0bcc6f3ec0 1 Processor -- start 2024-09-11T14:57:28.042 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.041+0000 7f0bcc6f3ec0 1 -- start start 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bcc6f3ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x10330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bcc6f3ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xf07520 con 0x1032740 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bc4a3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x10330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bc4a3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x10330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51860/0 (socket says 172.21.15.52:51860) 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bc4a3f640 1 -- 172.21.15.52:0/590514929 learned_addr learned my addr 172.21.15.52:0/590514929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bc4a3f640 1 -- 172.21.15.52:0/590514929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xea3e10 con 0x1032740 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.042+0000 7f0bc4a3f640 1 --2- 172.21.15.52:0/590514929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x10330f0 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4c700ec970c527 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bbeffd640 1 -- 172.21.15.52:0/590514929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bb800b4a0 con 0x1032740 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bbeffd640 1 -- 172.21.15.52:0/590514929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bb800b600 con 0x1032740 2024-09-11T14:57:28.045 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bbeffd640 1 -- 172.21.15.52:0/590514929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bb800b8a0 con 0x1032740 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/590514929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 msgr2=0x10330f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/590514929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x10330f0 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/590514929 shutdown_connections 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/590514929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x10330f0 unknown :-1 s=CLOSED pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/590514929 >> 172.21.15.52:0/590514929 conn(0xec7770 msgr2=0x10bd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/590514929 shutdown_connections 2024-09-11T14:57:28.046 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.043+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/590514929 wait complete. 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.044+0000 7f0bcc6f3ec0 1 Processor -- start 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.044+0000 7f0bcc6f3ec0 1 -- start start 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bcc6f3ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x101dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bcc6f3ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0xf05280 con 0x1032740 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bc4a3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x101dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bc4a3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x101dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51874/0 (socket says 172.21.15.52:51874) 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bc4a3f640 1 -- 172.21.15.52:0/1453441689 learned_addr learned my addr 172.21.15.52:0/1453441689 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bc4a3f640 1 -- 172.21.15.52:0/1453441689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe95920 con 0x1032740 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bc4a3f640 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x101dde0 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bbdffb640 1 -- 172.21.15.52:0/1453441689 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bb80128e0 con 0x1032740 2024-09-11T14:57:28.048 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bbdffb640 1 -- 172.21.15.52:0/1453441689 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bb8005040 con 0x1032740 2024-09-11T14:57:28.049 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bbdffb640 1 -- 172.21.15.52:0/1453441689 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bb8012b70 con 0x1032740 2024-09-11T14:57:28.049 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.046+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xe95380 con 0x1032740 2024-09-11T14:57:28.049 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.047+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1031cd0 con 0x1032740 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.048+0000 7f0bbdffb640 1 -- 172.21.15.52:0/1453441689 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0bb800d040 con 0x1032740 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.048+0000 7f0bbdffb640 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ba003d1c0 0x7f0ba003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.048+0000 7f0bbdffb640 1 -- 172.21.15.52:0/1453441689 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f0bb800a040 con 0x1032740 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.048+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> v2:172.21.15.143:6803/3147275988 conn(0x1032b50 0x1030a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.048+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x1020930 con 0x1032b50 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.048+0000 7f0bbffff640 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ba003d1c0 0x7f0ba003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.050 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.049+0000 7f0bbffff640 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ba003d1c0 0x7f0ba003f6d0 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.051 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.049+0000 7f0bc5240640 1 --2- 172.21.15.52:0/1453441689 >> v2:172.21.15.143:6803/3147275988 conn(0x1032b50 0x1030a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.054 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.053+0000 7f0bc5240640 1 --2- 172.21.15.52:0/1453441689 >> v2:172.21.15.143:6803/3147275988 conn(0x1032b50 0x1030a60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bc5240640 1 -- 172.21.15.52:0/1453441689 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj4 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0bb000a430 con 0x1032b50 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 >> v2:172.21.15.143:6803/3147275988 conn(0x1032b50 msgr2=0x1030a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> v2:172.21.15.143:6803/3147275988 conn(0x1032b50 0x1030a60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ba003d1c0 msgr2=0x7f0ba003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ba003d1c0 0x7f0ba003f6d0 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 msgr2=0x101dde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x101dde0 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.080 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 shutdown_connections 2024-09-11T14:57:28.081 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> v2:172.21.15.143:6803/3147275988 conn(0x1032b50 0x1030a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.081 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0ba003d1c0 0x7f0ba003f6d0 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.081 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 --2- 172.21.15.52:0/1453441689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1032740 0x101dde0 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.081 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 >> 172.21.15.52:0/1453441689 conn(0xec7770 msgr2=0x10bd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.081 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 shutdown_connections 2024-09-11T14:57:28.081 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.078+0000 7f0bcc6f3ec0 1 -- 172.21.15.52:0/1453441689 wait complete. 2024-09-11T14:57:28.082 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:28.082 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj5 /etc/passwd 2024-09-11T14:57:28.120 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.118+0000 7f58e7e2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.125 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.124+0000 7f58e7e2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.125 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.124+0000 7f58e7e2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.126 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.125+0000 7f58e7e2dec0 1 Processor -- start 2024-09-11T14:57:28.126 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.125+0000 7f58e7e2dec0 1 -- start start 2024-09-11T14:57:28.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.126+0000 7f58e7e2dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x1699560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.126+0000 7f58e7e2dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x14e3520 con 0x160e740 2024-09-11T14:57:28.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x1699560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.131 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x1699560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51890/0 (socket says 172.21.15.52:51890) 2024-09-11T14:57:28.132 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58db7fe640 1 -- 172.21.15.52:0/688106208 learned_addr learned my addr 172.21.15.52:0/688106208 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.132 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58db7fe640 1 -- 172.21.15.52:0/688106208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x147fe10 con 0x160e740 2024-09-11T14:57:28.132 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58db7fe640 1 --2- 172.21.15.52:0/688106208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x1699560 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8496bc3975e628ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.132 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58d9ffb640 1 -- 172.21.15.52:0/688106208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c8032040 con 0x160e740 2024-09-11T14:57:28.132 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58d9ffb640 1 -- 172.21.15.52:0/688106208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58c8033040 con 0x160e740 2024-09-11T14:57:28.133 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.127+0000 7f58d9ffb640 1 -- 172.21.15.52:0/688106208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c802dca0 con 0x160e740 2024-09-11T14:57:28.133 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/688106208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 msgr2=0x1699560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.133 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/688106208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x1699560 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.133 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/688106208 shutdown_connections 2024-09-11T14:57:28.133 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/688106208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x1699560 unknown :-1 s=CLOSED pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.133 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/688106208 >> 172.21.15.52:0/688106208 conn(0x14a3770 msgr2=0x1612100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.134 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/688106208 shutdown_connections 2024-09-11T14:57:28.134 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.128+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/688106208 wait complete. 2024-09-11T14:57:28.134 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.129+0000 7f58e7e2dec0 1 Processor -- start 2024-09-11T14:57:28.134 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.129+0000 7f58e7e2dec0 1 -- start start 2024-09-11T14:57:28.139 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.130+0000 7f58e7e2dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x160d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.139 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.130+0000 7f58e7e2dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x14e1280 con 0x160e740 2024-09-11T14:57:28.139 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.130+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x160d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.139 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.130+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x160d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51902/0 (socket says 172.21.15.52:51902) 2024-09-11T14:57:28.139 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.130+0000 7f58db7fe640 1 -- 172.21.15.52:0/3149522332 learned_addr learned my addr 172.21.15.52:0/3149522332 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.140 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58db7fe640 1 -- 172.21.15.52:0/3149522332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1471920 con 0x160e740 2024-09-11T14:57:28.140 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58db7fe640 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x160d9b0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.140 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58d8ff9640 1 -- 172.21.15.52:0/3149522332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c8032040 con 0x160e740 2024-09-11T14:57:28.140 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58d8ff9640 1 -- 172.21.15.52:0/3149522332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58c802db70 con 0x160e740 2024-09-11T14:57:28.140 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1471380 con 0x160e740 2024-09-11T14:57:28.141 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58d8ff9640 1 -- 172.21.15.52:0/3149522332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58c8035b80 con 0x160e740 2024-09-11T14:57:28.141 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.131+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1578130 con 0x160e740 2024-09-11T14:57:28.141 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.132+0000 7f58d8ff9640 1 -- 172.21.15.52:0/3149522332 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f58c8003040 con 0x160e740 2024-09-11T14:57:28.141 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.132+0000 7f58d8ff9640 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f58c403d1c0 0x7f58c403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.141 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.132+0000 7f58d8ff9640 1 -- 172.21.15.52:0/3149522332 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f58c8072fa0 con 0x160e740 2024-09-11T14:57:28.142 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.133+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> v2:172.21.15.143:6803/3147275988 conn(0x1611500 0x1576d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.142 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.133+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x15ff590 con 0x1611500 2024-09-11T14:57:28.142 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.133+0000 7f58daffd640 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f58c403d1c0 0x7f58c403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.142 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.133+0000 7f58daffd640 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f58c403d1c0 0x7f58c403f6d0 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.143 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.134+0000 7f58dbfff640 1 --2- 172.21.15.52:0/3149522332 >> v2:172.21.15.143:6803/3147275988 conn(0x1611500 0x1576d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.143 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.137+0000 7f58dbfff640 1 --2- 172.21.15.52:0/3149522332 >> v2:172.21.15.143:6803/3147275988 conn(0x1611500 0x1576d10 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.163+0000 7f58dbfff640 1 -- 172.21.15.52:0/3149522332 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj5 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f58d000c430 con 0x1611500 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 >> v2:172.21.15.143:6803/3147275988 conn(0x1611500 msgr2=0x1576d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> v2:172.21.15.143:6803/3147275988 conn(0x1611500 0x1576d10 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f58c403d1c0 msgr2=0x7f58c403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f58c403d1c0 0x7f58c403f6d0 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 msgr2=0x160d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x160d9b0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.166 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 shutdown_connections 2024-09-11T14:57:28.167 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> v2:172.21.15.143:6803/3147275988 conn(0x1611500 0x1576d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.167 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f58c403d1c0 0x7f58c403f6d0 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.167 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 --2- 172.21.15.52:0/3149522332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x160e740 0x160d9b0 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.167 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 >> 172.21.15.52:0/3149522332 conn(0x14a3770 msgr2=0x1612060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.167 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 shutdown_connections 2024-09-11T14:57:28.167 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.164+0000 7f58e7e2dec0 1 -- 172.21.15.52:0/3149522332 wait complete. 2024-09-11T14:57:28.168 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:28.168 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj6 /etc/passwd 2024-09-11T14:57:28.207 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.205+0000 7fcd27509ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.211+0000 7fcd27509ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.211+0000 7fcd27509ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.212+0000 7fcd27509ec0 1 Processor -- start 2024-09-11T14:57:28.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.212+0000 7fcd27509ec0 1 -- start start 2024-09-11T14:57:28.215 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd27509ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f60190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd27509ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1ec5520 con 0x1f588b0 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f60190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f60190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51920/0 (socket says 172.21.15.52:51920) 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd1affd640 1 -- 172.21.15.52:0/1126168316 learned_addr learned my addr 172.21.15.52:0/1126168316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd1affd640 1 -- 172.21.15.52:0/1126168316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e61e10 con 0x1f588b0 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd1affd640 1 --2- 172.21.15.52:0/1126168316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f60190 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c635c2e54e48e0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd19ffb640 1 -- 172.21.15.52:0/1126168316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd0c00b580 con 0x1f588b0 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd19ffb640 1 -- 172.21.15.52:0/1126168316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcd0c00b6e0 con 0x1f588b0 2024-09-11T14:57:28.216 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.214+0000 7fcd19ffb640 1 -- 172.21.15.52:0/1126168316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd0c00b980 con 0x1f588b0 2024-09-11T14:57:28.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1126168316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 msgr2=0x1f60190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1126168316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f60190 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1126168316 shutdown_connections 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1126168316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f60190 unknown :-1 s=CLOSED pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1126168316 >> 172.21.15.52:0/1126168316 conn(0x1e85770 msgr2=0x1f63590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1126168316 shutdown_connections 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.215+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1126168316 wait complete. 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.216+0000 7fcd27509ec0 1 Processor -- start 2024-09-11T14:57:28.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.216+0000 7fcd27509ec0 1 -- start start 2024-09-11T14:57:28.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd27509ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f5d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd27509ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1ec3280 con 0x1f588b0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f5d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f5d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51928/0 (socket says 172.21.15.52:51928) 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd1affd640 1 -- 172.21.15.52:0/1028626163 learned_addr learned my addr 172.21.15.52:0/1028626163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd1affd640 1 -- 172.21.15.52:0/1028626163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e53920 con 0x1f588b0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd1affd640 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f5d0b0 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd18ff9640 1 -- 172.21.15.52:0/1028626163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd0c012b10 con 0x1f588b0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd18ff9640 1 -- 172.21.15.52:0/1028626163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcd0c005040 con 0x1f588b0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd18ff9640 1 -- 172.21.15.52:0/1028626163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd0c012da0 con 0x1f588b0 2024-09-11T14:57:28.220 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e53380 con 0x1f588b0 2024-09-11T14:57:28.221 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.218+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1f5e0e0 con 0x1f588b0 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.219+0000 7fcd18ff9640 1 -- 172.21.15.52:0/1028626163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcd0c00d040 con 0x1f588b0 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.220+0000 7fcd18ff9640 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fccfc03d1c0 0x7fccfc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.220+0000 7fcd18ff9640 1 -- 172.21.15.52:0/1028626163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7fcd0c00a040 con 0x1f588b0 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.220+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> v2:172.21.15.52:6802/4284075780 conn(0x1ff5770 0x208af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.220+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 --> v2:172.21.15.52:6802/4284075780 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x1fe39d0 con 0x1ff5770 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.220+0000 7fcd13fff640 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fccfc03d1c0 0x7fccfc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.221+0000 7fcd13fff640 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fccfc03d1c0 0x7fccfc03f6d0 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.222 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.221+0000 7fcd1b7fe640 1 --2- 172.21.15.52:0/1028626163 >> v2:172.21.15.52:6802/4284075780 conn(0x1ff5770 0x208af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.224 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.223+0000 7fcd1b7fe640 1 --2- 172.21.15.52:0/1028626163 >> v2:172.21.15.52:6802/4284075780 conn(0x1ff5770 0x208af80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.249 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.247+0000 7fcd1b7fe640 1 -- 172.21.15.52:0/1028626163 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== osd_op_reply(1 obj6 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcd1400a430 con 0x1ff5770 2024-09-11T14:57:28.249 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 >> v2:172.21.15.52:6802/4284075780 conn(0x1ff5770 msgr2=0x208af80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.249 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> v2:172.21.15.52:6802/4284075780 conn(0x1ff5770 0x208af80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fccfc03d1c0 msgr2=0x7fccfc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fccfc03d1c0 0x7fccfc03f6d0 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 msgr2=0x1f5d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f5d0b0 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 shutdown_connections 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> v2:172.21.15.52:6802/4284075780 conn(0x1ff5770 0x208af80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fccfc03d1c0 0x7fccfc03f6d0 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 --2- 172.21.15.52:0/1028626163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1f588b0 0x1f5d0b0 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 >> 172.21.15.52:0/1028626163 conn(0x1e85770 msgr2=0x1f63590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 shutdown_connections 2024-09-11T14:57:28.250 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.248+0000 7fcd27509ec0 1 -- 172.21.15.52:0/1028626163 wait complete. 2024-09-11T14:57:28.251 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:28.252 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj7 /etc/passwd 2024-09-11T14:57:28.289 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.288+0000 7f50bfd37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.295 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.294+0000 7f50bfd37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.295 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.294+0000 7f50bfd37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.296 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.295+0000 7f50bfd37ec0 1 Processor -- start 2024-09-11T14:57:28.296 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.295+0000 7f50bfd37ec0 1 -- start start 2024-09-11T14:57:28.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50bfd37ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x1a02c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50bfd37ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1968520 con 0x1a96a70 2024-09-11T14:57:28.298 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x1a02c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x1a02c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51942/0 (socket says 172.21.15.52:51942) 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b3fff640 1 -- 172.21.15.52:0/3620540751 learned_addr learned my addr 172.21.15.52:0/3620540751 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b3fff640 1 -- 172.21.15.52:0/3620540751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1904e10 con 0x1a96a70 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b3fff640 1 --2- 172.21.15.52:0/3620540751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x1a02c60 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869178ffd6fa0dee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b27fc640 1 -- 172.21.15.52:0/3620540751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50ac00c490 con 0x1a96a70 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b27fc640 1 -- 172.21.15.52:0/3620540751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f50ac00c5f0 con 0x1a96a70 2024-09-11T14:57:28.299 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.297+0000 7f50b27fc640 1 -- 172.21.15.52:0/3620540751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50ac00c890 con 0x1a96a70 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/3620540751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 msgr2=0x1a02c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/3620540751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x1a02c60 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/3620540751 shutdown_connections 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/3620540751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x1a02c60 unknown :-1 s=CLOSED pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/3620540751 >> 172.21.15.52:0/3620540751 conn(0x1928770 msgr2=0x1a079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/3620540751 shutdown_connections 2024-09-11T14:57:28.300 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.298+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/3620540751 wait complete. 2024-09-11T14:57:28.301 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.299+0000 7f50bfd37ec0 1 Processor -- start 2024-09-11T14:57:28.301 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.299+0000 7f50bfd37ec0 1 -- start start 2024-09-11T14:57:28.302 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50bfd37ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x19fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.302 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50bfd37ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1966280 con 0x1a96a70 2024-09-11T14:57:28.302 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x19fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x19fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51958/0 (socket says 172.21.15.52:51958) 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b3fff640 1 -- 172.21.15.52:0/838303137 learned_addr learned my addr 172.21.15.52:0/838303137 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b3fff640 1 -- 172.21.15.52:0/838303137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18f6920 con 0x1a96a70 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b3fff640 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x19fbfc0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b17fa640 1 -- 172.21.15.52:0/838303137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50ac0111e0 con 0x1a96a70 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b17fa640 1 -- 172.21.15.52:0/838303137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f50ac011a30 con 0x1a96a70 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18f6380 con 0x1a96a70 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50b17fa640 1 -- 172.21.15.52:0/838303137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50ac011ba0 con 0x1a96a70 2024-09-11T14:57:28.303 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.301+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a93860 con 0x1a96a70 2024-09-11T14:57:28.304 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.302+0000 7f50b17fa640 1 -- 172.21.15.52:0/838303137 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f50ac011d50 con 0x1a96a70 2024-09-11T14:57:28.304 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.303+0000 7f50b17fa640 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f509403d1c0 0x7f509403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.304 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.303+0000 7f50b17fa640 1 -- 172.21.15.52:0/838303137 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f50ac050430 con 0x1a96a70 2024-09-11T14:57:28.304 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.303+0000 7f50b37fe640 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f509403d1c0 0x7f509403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.305 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.303+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> v2:172.21.15.52:6807/1907008724 conn(0x1a99910 0x1f31b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.305 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.303+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x1a931b0 con 0x1a99910 2024-09-11T14:57:28.305 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.303+0000 7f50b37fe640 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f509403d1c0 0x7f509403f6d0 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.305 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.304+0000 7f50b8e40640 1 --2- 172.21.15.52:0/838303137 >> v2:172.21.15.52:6807/1907008724 conn(0x1a99910 0x1f31b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.308 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.307+0000 7f50b8e40640 1 --2- 172.21.15.52:0/838303137 >> v2:172.21.15.52:6807/1907008724 conn(0x1a99910 0x1f31b50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.336 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50b8e40640 1 -- 172.21.15.52:0/838303137 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj7 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f50a400a430 con 0x1a99910 2024-09-11T14:57:28.336 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 >> v2:172.21.15.52:6807/1907008724 conn(0x1a99910 msgr2=0x1f31b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.336 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> v2:172.21.15.52:6807/1907008724 conn(0x1a99910 0x1f31b50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.336 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f509403d1c0 msgr2=0x7f509403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f509403d1c0 0x7f509403f6d0 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 msgr2=0x19fbfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x19fbfc0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 shutdown_connections 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> v2:172.21.15.52:6807/1907008724 conn(0x1a99910 0x1f31b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f509403d1c0 0x7f509403f6d0 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 --2- 172.21.15.52:0/838303137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1a96a70 0x19fbfc0 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.334+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 >> 172.21.15.52:0/838303137 conn(0x1928770 msgr2=0x1a07770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.335+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 shutdown_connections 2024-09-11T14:57:28.337 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.335+0000 7f50bfd37ec0 1 -- 172.21.15.52:0/838303137 wait complete. 2024-09-11T14:57:28.338 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:28.338 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj8 /etc/passwd 2024-09-11T14:57:28.376 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.374+0000 7fec99083ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.381 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.380+0000 7fec99083ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.381 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.380+0000 7fec99083ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.382 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.381+0000 7fec99083ec0 1 Processor -- start 2024-09-11T14:57:28.382 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.381+0000 7fec99083ec0 1 -- start start 2024-09-11T14:57:28.384 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec99083ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x261d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.384 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec99083ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x2467520 con 0x2592740 2024-09-11T14:57:28.384 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec9119b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x261d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.384 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec9119b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x261d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51982/0 (socket says 172.21.15.52:51982) 2024-09-11T14:57:28.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec9119b640 1 -- 172.21.15.52:0/609664490 learned_addr learned my addr 172.21.15.52:0/609664490 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec9119b640 1 -- 172.21.15.52:0/609664490 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2403e10 con 0x2592740 2024-09-11T14:57:28.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec9119b640 1 --2- 172.21.15.52:0/609664490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x261d560 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67186a51cb78220d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec8b7fe640 1 -- 172.21.15.52:0/609664490 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec7c032040 con 0x2592740 2024-09-11T14:57:28.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec8b7fe640 1 -- 172.21.15.52:0/609664490 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec7c033040 con 0x2592740 2024-09-11T14:57:28.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.383+0000 7fec8b7fe640 1 -- 172.21.15.52:0/609664490 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec7c02dcf0 con 0x2592740 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 -- 172.21.15.52:0/609664490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 msgr2=0x261d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 --2- 172.21.15.52:0/609664490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x261d560 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 -- 172.21.15.52:0/609664490 shutdown_connections 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 --2- 172.21.15.52:0/609664490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x261d560 unknown :-1 s=CLOSED pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 -- 172.21.15.52:0/609664490 >> 172.21.15.52:0/609664490 conn(0x2427770 msgr2=0x2596100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 -- 172.21.15.52:0/609664490 shutdown_connections 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.384+0000 7fec99083ec0 1 -- 172.21.15.52:0/609664490 wait complete. 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.385+0000 7fec99083ec0 1 Processor -- start 2024-09-11T14:57:28.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.385+0000 7fec99083ec0 1 -- start start 2024-09-11T14:57:28.388 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec99083ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x262a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.388 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec99083ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x2465280 con 0x2592740 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec9119b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x262a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec9119b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x262a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51992/0 (socket says 172.21.15.52:51992) 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec9119b640 1 -- 172.21.15.52:0/1806607975 learned_addr learned my addr 172.21.15.52:0/1806607975 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec9119b640 1 -- 172.21.15.52:0/1806607975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23f5920 con 0x2592740 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec9119b640 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x262a650 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec8a7fc640 1 -- 172.21.15.52:0/1806607975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec7c032040 con 0x2592740 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec8a7fc640 1 -- 172.21.15.52:0/1806607975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec7c02d970 con 0x2592740 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x23f5380 con 0x2592740 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec8a7fc640 1 -- 172.21.15.52:0/1806607975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec7c02dcf0 con 0x2592740 2024-09-11T14:57:28.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.387+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x257e110 con 0x2592740 2024-09-11T14:57:28.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.388+0000 7fec8a7fc640 1 -- 172.21.15.52:0/1806607975 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fec7c037b00 con 0x2592740 2024-09-11T14:57:28.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.388+0000 7fec8a7fc640 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fec6c03d1c0 0x7fec6c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.389+0000 7fec8a7fc640 1 -- 172.21.15.52:0/1806607975 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7fec7c073170 con 0x2592740 2024-09-11T14:57:28.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.389+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> v2:172.21.15.52:6807/1907008724 conn(0x2595500 0x2590f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.389+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x2580cc0 con 0x2595500 2024-09-11T14:57:28.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.389+0000 7fec9099a640 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fec6c03d1c0 0x7fec6c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.391 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.389+0000 7fec9199c640 1 --2- 172.21.15.52:0/1806607975 >> v2:172.21.15.52:6807/1907008724 conn(0x2595500 0x2590f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.391 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.389+0000 7fec9099a640 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fec6c03d1c0 0x7fec6c03f6d0 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.393 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.392+0000 7fec9199c640 1 --2- 172.21.15.52:0/1806607975 >> v2:172.21.15.52:6807/1907008724 conn(0x2595500 0x2590f50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec9199c640 1 -- 172.21.15.52:0/1806607975 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj8 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fec8400c430 con 0x2595500 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 >> v2:172.21.15.52:6807/1907008724 conn(0x2595500 msgr2=0x2590f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> v2:172.21.15.52:6807/1907008724 conn(0x2595500 0x2590f50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fec6c03d1c0 msgr2=0x7fec6c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fec6c03d1c0 0x7fec6c03f6d0 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 msgr2=0x262a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x262a650 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 shutdown_connections 2024-09-11T14:57:28.422 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> v2:172.21.15.52:6807/1907008724 conn(0x2595500 0x2590f50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.423 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fec6c03d1c0 0x7fec6c03f6d0 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.423 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 --2- 172.21.15.52:0/1806607975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x2592740 0x262a650 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.423 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 >> 172.21.15.52:0/1806607975 conn(0x2427770 msgr2=0x24ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.423 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 shutdown_connections 2024-09-11T14:57:28.423 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.420+0000 7fec99083ec0 1 -- 172.21.15.52:0/1806607975 wait complete. 2024-09-11T14:57:28.424 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:28.424 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj9 /etc/passwd 2024-09-11T14:57:28.461 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.460+0000 7f7fd2888ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.467 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.466+0000 7f7fd2888ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.467 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.466+0000 7f7fd2888ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.468 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.467+0000 7f7fd2888ec0 1 Processor -- start 2024-09-11T14:57:28.468 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.467+0000 7f7fd2888ec0 1 -- start start 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.468+0000 7f7fd2888ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dfcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.468+0000 7f7fd2888ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1cd0520 con 0x1dfb740 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.468+0000 7f7fca99b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dfcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.468+0000 7f7fca99b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dfcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52010/0 (socket says 172.21.15.52:52010) 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.468+0000 7f7fca99b640 1 -- 172.21.15.52:0/2179143802 learned_addr learned my addr 172.21.15.52:0/2179143802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.469+0000 7f7fca99b640 1 -- 172.21.15.52:0/2179143802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c6ce10 con 0x1dfb740 2024-09-11T14:57:28.470 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.469+0000 7f7fca99b640 1 --2- 172.21.15.52:0/2179143802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dfcdc0 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5603a868bc77bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.471 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.469+0000 7f7fc9198640 1 -- 172.21.15.52:0/2179143802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fb4032040 con 0x1dfb740 2024-09-11T14:57:28.471 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.469+0000 7f7fc9198640 1 -- 172.21.15.52:0/2179143802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7fb4033040 con 0x1dfb740 2024-09-11T14:57:28.471 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.469+0000 7f7fc9198640 1 -- 172.21.15.52:0/2179143802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fb402db70 con 0x1dfb740 2024-09-11T14:57:28.472 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/2179143802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 msgr2=0x1dfcdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.472 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/2179143802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dfcdc0 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.472 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/2179143802 shutdown_connections 2024-09-11T14:57:28.472 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/2179143802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dfcdc0 unknown :-1 s=CLOSED pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.472 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/2179143802 >> 172.21.15.52:0/2179143802 conn(0x1c90770 msgr2=0x1e84550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.472 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/2179143802 shutdown_connections 2024-09-11T14:57:28.473 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.470+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/2179143802 wait complete. 2024-09-11T14:57:28.473 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.471+0000 7f7fd2888ec0 1 Processor -- start 2024-09-11T14:57:28.473 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.471+0000 7f7fd2888ec0 1 -- start start 2024-09-11T14:57:28.474 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.472+0000 7f7fd2888ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.474 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.472+0000 7f7fd2888ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x1cce280 con 0x1dfb740 2024-09-11T14:57:28.474 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.472+0000 7f7fca99b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.474 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.472+0000 7f7fca99b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52022/0 (socket says 172.21.15.52:52022) 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.472+0000 7f7fca99b640 1 -- 172.21.15.52:0/1604550206 learned_addr learned my addr 172.21.15.52:0/1604550206 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fca99b640 1 -- 172.21.15.52:0/1604550206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c5e920 con 0x1dfb740 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fca99b640 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dea100 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fc3fff640 1 -- 172.21.15.52:0/1604550206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fb4032040 con 0x1dfb740 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fc3fff640 1 -- 172.21.15.52:0/1604550206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7fb402dd70 con 0x1dfb740 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c5e380 con 0x1dfb740 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fc3fff640 1 -- 172.21.15.52:0/1604550206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fb402d5c0 con 0x1dfb740 2024-09-11T14:57:28.475 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.473+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1de9de0 con 0x1dfb740 2024-09-11T14:57:28.476 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.474+0000 7f7fc3fff640 1 -- 172.21.15.52:0/1604550206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7fb4003040 con 0x1dfb740 2024-09-11T14:57:28.476 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.474+0000 7f7fc3fff640 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7fb003d1c0 0x7f7fb003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.477 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.474+0000 7f7fc3fff640 1 -- 172.21.15.52:0/1604550206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7f7fb4073130 con 0x1dfb740 2024-09-11T14:57:28.477 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.475+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> v2:172.21.15.143:6803/3147275988 conn(0x1dfe500 0x1e93d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.477 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.475+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 --> v2:172.21.15.143:6803/3147275988 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x1deca60 con 0x1dfe500 2024-09-11T14:57:28.477 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.475+0000 7f7fca19a640 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7fb003d1c0 0x7f7fb003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.477 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.475+0000 7f7fca19a640 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7fb003d1c0 0x7f7fb003f6d0 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.477 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.475+0000 7f7fcb19c640 1 --2- 172.21.15.52:0/1604550206 >> v2:172.21.15.143:6803/3147275988 conn(0x1dfe500 0x1e93d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.479 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.478+0000 7f7fcb19c640 1 --2- 172.21.15.52:0/1604550206 >> v2:172.21.15.143:6803/3147275988 conn(0x1dfe500 0x1e93d30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fcb19c640 1 -- 172.21.15.52:0/1604550206 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== osd_op_reply(1 obj9 [writefull 0~12777] v723'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7fbc00c430 con 0x1dfe500 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 >> v2:172.21.15.143:6803/3147275988 conn(0x1dfe500 msgr2=0x1e93d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> v2:172.21.15.143:6803/3147275988 conn(0x1dfe500 0x1e93d30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7fb003d1c0 msgr2=0x7f7fb003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7fb003d1c0 0x7f7fb003f6d0 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 msgr2=0x1dea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.503 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dea100 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 shutdown_connections 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> v2:172.21.15.143:6803/3147275988 conn(0x1dfe500 0x1e93d30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f7fb003d1c0 0x7f7fb003f6d0 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 --2- 172.21.15.52:0/1604550206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x1dfb740 0x1dea100 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.501+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 >> 172.21.15.52:0/1604550206 conn(0x1c90770 msgr2=0x1e84550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.502+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 shutdown_connections 2024-09-11T14:57:28.504 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.502+0000 7f7fd2888ec0 1 -- 172.21.15.52:0/1604550206 wait complete. 2024-09-11T14:57:28.505 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in `seq 1 10` 2024-09-11T14:57:28.505 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 96b90da5-7bb8-428c-a88c-95404cb5f515 put obj10 /etc/passwd 2024-09-11T14:57:28.543 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.542+0000 7fd697269ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.549 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.548+0000 7fd697269ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.549 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.548+0000 7fd697269ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:28.550 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.549+0000 7fd697269ec0 1 Processor -- start 2024-09-11T14:57:28.550 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.549+0000 7fd697269ec0 1 -- start start 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.550+0000 7fd697269ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.550+0000 7fd697269ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x8cd520 con 0x9fa8a0 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.550+0000 7fd68f39b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.550+0000 7fd68f39b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52036/0 (socket says 172.21.15.52:52036) 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.550+0000 7fd68f39b640 1 -- 172.21.15.52:0/3548743608 learned_addr learned my addr 172.21.15.52:0/3548743608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.551+0000 7fd68f39b640 1 -- 172.21.15.52:0/3548743608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x869e10 con 0x9fa8a0 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.551+0000 7fd68f39b640 1 --2- 172.21.15.52:0/3548743608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9670c0 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3bd7ad1cabea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.552 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.551+0000 7fd68db98640 1 -- 172.21.15.52:0/3548743608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd67800b580 con 0x9fa8a0 2024-09-11T14:57:28.553 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.551+0000 7fd68db98640 1 -- 172.21.15.52:0/3548743608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd67800b6e0 con 0x9fa8a0 2024-09-11T14:57:28.553 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.551+0000 7fd68db98640 1 -- 172.21.15.52:0/3548743608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd67800b980 con 0x9fa8a0 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 -- 172.21.15.52:0/3548743608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 msgr2=0x9670c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 --2- 172.21.15.52:0/3548743608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9670c0 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 -- 172.21.15.52:0/3548743608 shutdown_connections 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 --2- 172.21.15.52:0/3548743608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9670c0 unknown :-1 s=CLOSED pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 -- 172.21.15.52:0/3548743608 >> 172.21.15.52:0/3548743608 conn(0x88d770 msgr2=0x9f4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 -- 172.21.15.52:0/3548743608 shutdown_connections 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.552+0000 7fd697269ec0 1 -- 172.21.15.52:0/3548743608 wait complete. 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.553+0000 7fd697269ec0 1 Processor -- start 2024-09-11T14:57:28.554 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.553+0000 7fd697269ec0 1 -- start start 2024-09-11T14:57:28.556 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.554+0000 7fd697269ec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.556 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.554+0000 7fd697269ec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x8cb280 con 0x9fa8a0 2024-09-11T14:57:28.556 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.554+0000 7fd68f39b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.556 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.554+0000 7fd68f39b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9e3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52050/0 (socket says 172.21.15.52:52050) 2024-09-11T14:57:28.556 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.554+0000 7fd68f39b640 1 -- 172.21.15.52:0/93606094 learned_addr learned my addr 172.21.15.52:0/93606094 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd68f39b640 1 -- 172.21.15.52:0/93606094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x85b920 con 0x9fa8a0 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd68f39b640 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9e3a20 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd68cb96640 1 -- 172.21.15.52:0/93606094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd678012b10 con 0x9fa8a0 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd68cb96640 1 -- 172.21.15.52:0/93606094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd678005040 con 0x9fa8a0 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd68cb96640 1 -- 172.21.15.52:0/93606094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd678012da0 con 0x9fa8a0 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x85b380 con 0x9fa8a0 2024-09-11T14:57:28.557 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.555+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x9e5f30 con 0x9fa8a0 2024-09-11T14:57:28.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.556+0000 7fd68cb96640 1 -- 172.21.15.52:0/93606094 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd67800d040 con 0x9fa8a0 2024-09-11T14:57:28.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.556+0000 7fd68cb96640 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd67403d210 0x7fd67403f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.556+0000 7fd68cb96640 1 -- 172.21.15.52:0/93606094 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(723..723 src has 412..723) ==== 4207+0+0 (crc 0 0 0) 0x7fd67800a040 con 0x9fa8a0 2024-09-11T14:57:28.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.556+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> v2:172.21.15.52:6807/1907008724 conn(0x9fd900 0xe94b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:28.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.556+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 --> v2:172.21.15.52:6807/1907008724 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x9e6760 con 0x9fd900 2024-09-11T14:57:28.558 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.557+0000 7fd68eb9a640 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd67403d210 0x7fd67403f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:28.559 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.557+0000 7fd68eb9a640 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd67403d210 0x7fd67403f720 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.559 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.557+0000 7fd68fb9c640 1 --2- 172.21.15.52:0/93606094 >> v2:172.21.15.52:6807/1907008724 conn(0x9fd900 0xe94b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:28.562 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.561+0000 7fd68fb9c640 1 --2- 172.21.15.52:0/93606094 >> v2:172.21.15.52:6807/1907008724 conn(0x9fd900 0xe94b30 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:28.585 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.583+0000 7fd68fb9c640 1 -- 172.21.15.52:0/93606094 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== osd_op_reply(1 obj10 [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd68000a430 con 0x9fd900 2024-09-11T14:57:28.585 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.583+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 >> v2:172.21.15.52:6807/1907008724 conn(0x9fd900 msgr2=0xe94b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.583+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> v2:172.21.15.52:6807/1907008724 conn(0x9fd900 0xe94b30 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd67403d210 msgr2=0x7fd67403f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd67403d210 0x7fd67403f720 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 msgr2=0x9e3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9e3a20 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 shutdown_connections 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> v2:172.21.15.52:6807/1907008724 conn(0x9fd900 0xe94b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fd67403d210 0x7fd67403f720 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 --2- 172.21.15.52:0/93606094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x9fa8a0 0x9e3a20 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 >> 172.21.15.52:0/93606094 conn(0x88d770 msgr2=0x9670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 shutdown_connections 2024-09-11T14:57:28.586 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:28.584+0000 7fd697269ec0 1 -- 172.21.15.52:0/93606094 wait complete. 2024-09-11T14:57:28.587 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 30 2024-09-11T14:57:58.589 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados -p 44c281f7-10ec-4da5-9213-49ec274d2684 put threemore /etc/passwd 2024-09-11T14:57:58.634 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.632+0000 7f8b2f43dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:58.640 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.638+0000 7f8b2f43dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:58.641 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.638+0000 7f8b2f43dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:58.641 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.639+0000 7f8b2f43dec0 1 Processor -- start 2024-09-11T14:57:58.641 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.639+0000 7f8b2f43dec0 1 -- start start 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.641+0000 7f8b2f43dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x936730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.641+0000 7f8b2f43dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x782520 con 0x8af7f0 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.641+0000 7f8b2759b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x936730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.641+0000 7f8b2759b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x936730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47854/0 (socket says 172.21.15.52:47854) 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.641+0000 7f8b2759b640 1 -- 172.21.15.52:0/3914821368 learned_addr learned my addr 172.21.15.52:0/3914821368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.642+0000 7f8b2759b640 1 -- 172.21.15.52:0/3914821368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x71ee10 con 0x8af7f0 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.642+0000 7f8b2759b640 1 --2- 172.21.15.52:0/3914821368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x936730 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfea1cec468c5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.642+0000 7f8b25d98640 1 -- 172.21.15.52:0/3914821368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b1002dea0 con 0x8af7f0 2024-09-11T14:57:58.644 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.642+0000 7f8b25d98640 1 -- 172.21.15.52:0/3914821368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8b1002dca0 con 0x8af7f0 2024-09-11T14:57:58.645 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.642+0000 7f8b25d98640 1 -- 172.21.15.52:0/3914821368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b100374a0 con 0x8af7f0 2024-09-11T14:57:58.645 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3914821368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 msgr2=0x936730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:58.645 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3914821368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x936730 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3914821368 shutdown_connections 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3914821368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x936730 unknown :-1 s=CLOSED pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3914821368 >> 172.21.15.52:0/3914821368 conn(0x742770 msgr2=0x817690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3914821368 shutdown_connections 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.643+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3914821368 wait complete. 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.644+0000 7f8b2f43dec0 1 Processor -- start 2024-09-11T14:57:58.646 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.644+0000 7f8b2f43dec0 1 -- start start 2024-09-11T14:57:58.648 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.645+0000 7f8b2f43dec0 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x947bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.645+0000 7f8b2f43dec0 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x780280 con 0x8af7f0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2759b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x947bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2759b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x947bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47860/0 (socket says 172.21.15.52:47860) 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2759b640 1 -- 172.21.15.52:0/3896401830 learned_addr learned my addr 172.21.15.52:0/3896401830 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2759b640 1 -- 172.21.15.52:0/3896401830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x710920 con 0x8af7f0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2759b640 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x947bc0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b24d96640 1 -- 172.21.15.52:0/3896401830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b1003e040 con 0x8af7f0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b24d96640 1 -- 172.21.15.52:0/3896401830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8b10039ae0 con 0x8af7f0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x710380 con 0x8af7f0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b24d96640 1 -- 172.21.15.52:0/3896401830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b1002dea0 con 0x8af7f0 2024-09-11T14:57:58.649 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.646+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x947800 con 0x8af7f0 2024-09-11T14:57:58.650 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.647+0000 7f8b24d96640 1 -- 172.21.15.52:0/3896401830 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8b10006380 con 0x8af7f0 2024-09-11T14:57:58.650 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.648+0000 7f8b24d96640 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f8b0c03d1c0 0x7f8b0c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.650 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.648+0000 7f8b24d96640 1 -- 172.21.15.52:0/3896401830 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(725..725 src has 412..725) ==== 4207+0+0 (crc 0 0 0) 0x7f8b10032040 con 0x8af7f0 2024-09-11T14:57:58.650 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.648+0000 7f8b24d96640 1 -- 172.21.15.52:0/3896401830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7f8b0c043d00 con 0x8af7f0 2024-09-11T14:57:58.650 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.648+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> v2:172.21.15.143:6808/2099775818 conn(0x8b0140 0x89b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.651 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.648+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 --> v2:172.21.15.143:6808/2099775818 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e725) -- 0x8047b0 con 0x8b0140 2024-09-11T14:57:58.651 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.648+0000 7f8b26d9a640 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f8b0c03d1c0 0x7f8b0c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:58.651 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.649+0000 7f8b26d9a640 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f8b0c03d1c0 0x7f8b0c03f6d0 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.651 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.649+0000 7f8b27d9c640 1 --2- 172.21.15.52:0/3896401830 >> v2:172.21.15.143:6808/2099775818 conn(0x8b0140 0x89b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:57:58.655 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.653+0000 7f8b27d9c640 1 --2- 172.21.15.52:0/3896401830 >> v2:172.21.15.143:6808/2099775818 conn(0x8b0140 0x89b1a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.690 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b27d9c640 1 -- 172.21.15.52:0/3896401830 <== osd.2 v2:172.21.15.143:6808/2099775818 1 ==== osd_op_reply(1 threemore [writefull 0~12777] v725'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f8b1800a430 con 0x8b0140 2024-09-11T14:57:58.690 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 >> v2:172.21.15.143:6808/2099775818 conn(0x8b0140 msgr2=0x89b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:58.690 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> v2:172.21.15.143:6808/2099775818 conn(0x8b0140 0x89b1a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f8b0c03d1c0 msgr2=0x7f8b0c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f8b0c03d1c0 0x7f8b0c03f6d0 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 msgr2=0x947bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x947bc0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 shutdown_connections 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> v2:172.21.15.143:6808/2099775818 conn(0x8b0140 0x89b1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f8b0c03d1c0 0x7f8b0c03f6d0 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 --2- 172.21.15.52:0/3896401830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x8af7f0 0x947bc0 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 >> 172.21.15.52:0/3896401830 conn(0x742770 msgr2=0x8175f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 shutdown_connections 2024-09-11T14:57:58.691 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.688+0000 7f8b2f43dec0 1 -- 172.21.15.52:0/3896401830 wait complete. 2024-09-11T14:57:58.692 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_bytes 0 2024-09-11T14:57:58.797 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.786+0000 7f1b0a85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:58.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.796+0000 7f1b0a85c640 1 Processor -- start 2024-09-11T14:57:58.798 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.796+0000 7f1b0a85c640 1 -- start start 2024-09-11T14:57:58.800 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.797+0000 7f1b0a85c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b040a0390 0x7f1b0413b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.800 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b0a85c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b04074b50 con 0x7f1b0409f870 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b0a85c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1b040a0c60 con 0x7f1b040a0390 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b037fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b040a0390 0x7f1b0413b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b037fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b040a0390 0x7f1b0413b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47876/0 (socket says 172.21.15.52:47876) 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b037fe640 1 -- 172.21.15.52:0/1164890958 learned_addr learned my addr 172.21.15.52:0/1164890958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b03fff640 1 --1- 172.21.15.52:0/1164890958 >> v1:172.21.15.52:6789/0 conn(0x7f1b0409f870 0x7f1b0409fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50440/0 (socket says 172.21.15.52:50440) 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b037fe640 1 -- 172.21.15.52:0/1164890958 >> v1:172.21.15.52:6789/0 conn(0x7f1b0409f870 legacy=0x7f1b0409fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b037fe640 1 -- 172.21.15.52:0/1164890958 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b040a2110 con 0x7f1b040a0390 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b037fe640 1 --2- 172.21.15.52:0/1164890958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b040a0390 0x7f1b0413b700 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b51e5d86e4bf069 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b02ffd640 1 -- 172.21.15.52:0/1164890958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1af8009e40 con 0x7f1b040a0390 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b02ffd640 1 -- 172.21.15.52:0/1164890958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1af800e230 con 0x7f1b040a0390 2024-09-11T14:57:58.801 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.798+0000 7f1b02ffd640 1 -- 172.21.15.52:0/1164890958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1af800e4d0 con 0x7f1b040a0390 2024-09-11T14:57:58.802 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 -- 172.21.15.52:0/1164890958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b040a0390 msgr2=0x7f1b0413b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:57:58.802 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 --2- 172.21.15.52:0/1164890958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b040a0390 0x7f1b0413b700 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.802 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 -- 172.21.15.52:0/1164890958 shutdown_connections 2024-09-11T14:57:58.802 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 --2- 172.21.15.52:0/1164890958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b040a0390 0x7f1b0413b700 unknown :-1 s=CLOSED pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:57:58.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 -- 172.21.15.52:0/1164890958 >> 172.21.15.52:0/1164890958 conn(0x7f1b040a6270 msgr2=0x7f1b040a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:57:58.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 -- 172.21.15.52:0/1164890958 shutdown_connections 2024-09-11T14:57:58.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 1 -- 172.21.15.52:0/1164890958 wait complete. 2024-09-11T14:57:58.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.799+0000 7f1b0a85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:57:58.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.801+0000 7f1b0a85c640 1 Processor -- start 2024-09-11T14:57:58.803 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.801+0000 7f1b0a85c640 1 -- start start 2024-09-11T14:57:58.805 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.803+0000 7f1b0a85c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 0x7f1b041319b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.805 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.803+0000 7f1b0a85c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04132b80 con 0x7f1b0409f870 2024-09-11T14:57:58.805 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.803+0000 7f1b03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 0x7f1b041319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:58.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.803+0000 7f1b03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 0x7f1b041319b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47890/0 (socket says 172.21.15.52:47890) 2024-09-11T14:57:58.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.803+0000 7f1b03fff640 1 -- 172.21.15.52:0/708696181 learned_addr learned my addr 172.21.15.52:0/708696181 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:57:58.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.803+0000 7f1b03fff640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b04132f50 con 0x7f1b0409f870 2024-09-11T14:57:58.806 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.804+0000 7f1b03fff640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 0x7f1b041319b0 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.804+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1af40059a0 con 0x7f1b0409f870 2024-09-11T14:57:58.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.804+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1af4005b00 con 0x7f1b0409f870 2024-09-11T14:57:58.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.804+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b04131610 con 0x7f1b0409f870 2024-09-11T14:57:58.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.804+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1af4005da0 con 0x7f1b0409f870 2024-09-11T14:57:58.807 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.804+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b04133850 con 0x7f1b0409f870 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.805+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1af40070b0 con 0x7f1b0409f870 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.805+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0409fc80 con 0x7f1b0409f870 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.805+0000 7f1b00ff9640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1af003e960 0x7f1af0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.805+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(725..725 src has 412..725) ==== 4207+0+0 (crc 0 0 0) 0x7f1af404fc00 con 0x7f1b0409f870 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.805+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7f1af0045390 con 0x7f1b0409f870 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.805+0000 7f1b037fe640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1af003e960 0x7f1af0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:57:58.808 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.806+0000 7f1b037fe640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1af003e960 0x7f1af0040e70 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:57:58.812 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:58.810+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1af400f420 con 0x7f1b0409f870 2024-09-11T14:57:59.008 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:59.006+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"} v 0) -- 0x7f1b04050fc0 con 0x7f1b0409f870 2024-09-11T14:57:59.059 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:59.057+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v726) ==== 217+0+0 (crc 0 0 0) 0x7f1af400d150 con 0x7f1b0409f870 2024-09-11T14:57:59.059 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:59.057+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(726..726 src has 412..726) ==== 628+0+0 (crc 0 0 0) 0x7f1af400dbe0 con 0x7f1b0409f870 2024-09-11T14:57:59.060 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:59.057+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=727}) -- 0x7f1af0046470 con 0x7f1b0409f870 2024-09-11T14:57:59.193 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:57:59.191+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"} v 0) -- 0x7f1b041343e0 con 0x7f1b0409f870 2024-09-11T14:58:00.067 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.065+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v727) ==== 217+0+0 (crc 0 0 0) 0x7f1af400d840 con 0x7f1b0409f870 2024-09-11T14:58:00.068 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_bytes = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:58:00.068 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.065+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 <== mon.0 v2:172.21.15.52:3300/0 10 ==== osd_map(727..727 src has 412..727) ==== 628+0+0 (crc 0 0 0) 0x7f1af400ac40 con 0x7f1b0409f870 2024-09-11T14:58:00.068 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.065+0000 7f1b00ff9640 1 -- 172.21.15.52:0/708696181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=728}) -- 0x7f1af0046520 con 0x7f1b0409f870 2024-09-11T14:58:00.072 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1af003e960 msgr2=0x7f1af0040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1af003e960 0x7f1af0040e70 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 msgr2=0x7f1b041319b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 0x7f1b041319b0 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 shutdown_connections 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1af003e960 0x7f1af0040e70 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 --2- 172.21.15.52:0/708696181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b0409f870 0x7f1b041319b0 crc :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 >> 172.21.15.52:0/708696181 conn(0x7f1b040a6270 msgr2=0x7f1b040706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 shutdown_connections 2024-09-11T14:58:00.073 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.070+0000 7f1b0a85c640 1 -- 172.21.15.52:0/708696181 wait complete. 2024-09-11T14:58:00.091 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool set-quota 44c281f7-10ec-4da5-9213-49ec274d2684 max_objects 0 2024-09-11T14:58:00.207 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.197+0000 7f3e96591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:00.209 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.207+0000 7f3e96591640 1 Processor -- start 2024-09-11T14:58:00.209 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.207+0000 7f3e96591640 1 -- start start 2024-09-11T14:58:00.211 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.208+0000 7f3e96591640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e90070160 0x7f3e9013b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:00.211 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.208+0000 7f3e96591640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900a27d0 con 0x7f3e9006f640 2024-09-11T14:58:00.211 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.208+0000 7f3e96591640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3e900a1ec0 con 0x7f3e90070160 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e87fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e90070160 0x7f3e9013b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e87fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e90070160 0x7f3e9013b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47892/0 (socket says 172.21.15.52:47892) 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e8ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e9006f640 0x7f3e9006fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50444/0 (socket says 172.21.15.52:50444) 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e87fff640 1 -- 172.21.15.52:0/1086290591 learned_addr learned my addr 172.21.15.52:0/1086290591 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e87fff640 1 -- 172.21.15.52:0/1086290591 >> v1:172.21.15.52:6789/0 conn(0x7f3e9006f640 legacy=0x7f3e9006fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e87fff640 1 -- 172.21.15.52:0/1086290591 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e90070ab0 con 0x7f3e90070160 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e87fff640 1 --2- 172.21.15.52:0/1086290591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e90070160 0x7f3e9013b0e0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307cec67f1164319 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e8f7fe640 1 -- 172.21.15.52:0/1086290591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e78009e50 con 0x7f3e90070160 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e8f7fe640 1 -- 172.21.15.52:0/1086290591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e7800e230 con 0x7f3e90070160 2024-09-11T14:58:00.212 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.209+0000 7f3e8f7fe640 1 -- 172.21.15.52:0/1086290591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e7800e4d0 con 0x7f3e90070160 2024-09-11T14:58:00.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 -- 172.21.15.52:0/1086290591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e90070160 msgr2=0x7f3e9013b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:00.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 --2- 172.21.15.52:0/1086290591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e90070160 0x7f3e9013b0e0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:00.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 -- 172.21.15.52:0/1086290591 shutdown_connections 2024-09-11T14:58:00.213 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 --2- 172.21.15.52:0/1086290591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e90070160 0x7f3e9013b0e0 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:00.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 -- 172.21.15.52:0/1086290591 >> 172.21.15.52:0/1086290591 conn(0x7f3e900a6d10 msgr2=0x7f3e90073860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:00.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 -- 172.21.15.52:0/1086290591 shutdown_connections 2024-09-11T14:58:00.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 1 -- 172.21.15.52:0/1086290591 wait complete. 2024-09-11T14:58:00.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.210+0000 7f3e96591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:00.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.212+0000 7f3e96591640 1 Processor -- start 2024-09-11T14:58:00.214 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.212+0000 7f3e96591640 1 -- start start 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e96591640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 0x7f3e9011e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e96591640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90122590 con 0x7f3e9006f640 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 0x7f3e9011e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 0x7f3e9011e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47902/0 (socket says 172.21.15.52:47902) 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8ffff640 1 -- 172.21.15.52:0/546282787 learned_addr learned my addr 172.21.15.52:0/546282787 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8ffff640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e90122830 con 0x7f3e9006f640 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8ffff640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 0x7f3e9011e850 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e800059a0 con 0x7f3e9006f640 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e80005b00 con 0x7f3e9006f640 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e80005da0 con 0x7f3e9006f640 2024-09-11T14:58:00.217 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.214+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e901210f0 con 0x7f3e9006f640 2024-09-11T14:58:00.218 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.215+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e90132d50 con 0x7f3e9006f640 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.216+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3e800070b0 con 0x7f3e9006f640 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.216+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e90120b40 con 0x7f3e9006f640 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.216+0000 7f3e8d7fa640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3e7003e930 0x7f3e70040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.216+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(727..727 src has 412..727) ==== 4207+0+0 (crc 0 0 0) 0x7f3e8004fc80 con 0x7f3e9006f640 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.216+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=728}) -- 0x7f3e70045360 con 0x7f3e9006f640 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.216+0000 7f3e87fff640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3e7003e930 0x7f3e70040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:00.219 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.217+0000 7f3e87fff640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3e7003e930 0x7f3e70040e40 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:00.223 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.221+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3e8000f420 con 0x7f3e9006f640 2024-09-11T14:58:00.410 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:00.407+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"} v 0) -- 0x7f3e900a2120 con 0x7f3e9006f640 2024-09-11T14:58:01.068 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.066+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v728) ==== 221+0+0 (crc 0 0 0) 0x7f3e8000d150 con 0x7f3e9006f640 2024-09-11T14:58:01.068 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.066+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(728..728 src has 412..728) ==== 628+0+0 (crc 0 0 0) 0x7f3e8000dbe0 con 0x7f3e9006f640 2024-09-11T14:58:01.069 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.066+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=729}) -- 0x7f3e700461a0 con 0x7f3e9006f640 2024-09-11T14:58:01.195 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.193+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"} v 0) -- 0x7f3e900008d0 con 0x7f3e9006f640 2024-09-11T14:58:01.692 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.690+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 v729) ==== 221+0+0 (crc 0 0 0) 0x7f3e8000d840 con 0x7f3e9006f640 2024-09-11T14:58:01.692 INFO:tasks.workunit.client.0.smithi052.stderr:set-quota max_objects = 0 for pool 44c281f7-10ec-4da5-9213-49ec274d2684 2024-09-11T14:58:01.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.690+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 <== mon.0 v2:172.21.15.52:3300/0 10 ==== osd_map(729..729 src has 412..729) ==== 628+0+0 (crc 0 0 0) 0x7f3e8000ac40 con 0x7f3e9006f640 2024-09-11T14:58:01.693 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.690+0000 7f3e8d7fa640 1 -- 172.21.15.52:0/546282787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=730}) -- 0x7f3e70046480 con 0x7f3e9006f640 2024-09-11T14:58:01.696 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3e7003e930 msgr2=0x7f3e70040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:01.696 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3e7003e930 0x7f3e70040e40 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:01.696 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 msgr2=0x7f3e9011e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:01.696 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 0x7f3e9011e850 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:01.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 shutdown_connections 2024-09-11T14:58:01.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3e7003e930 0x7f3e70040e40 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:01.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 --2- 172.21.15.52:0/546282787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e9006f640 0x7f3e9011e850 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:01.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 >> 172.21.15.52:0/546282787 conn(0x7f3e900a6d10 msgr2=0x7f3e90071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:01.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 shutdown_connections 2024-09-11T14:58:01.697 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:01.694+0000 7f3e96591640 1 -- 172.21.15.52:0/546282787 wait complete. 2024-09-11T14:58:01.716 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 30 2024-09-11T14:58:31.718 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool delete 44c281f7-10ec-4da5-9213-49ec274d2684 44c281f7-10ec-4da5-9213-49ec274d2684 --yes-i-really-really-mean-it 2024-09-11T14:58:31.830 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.820+0000 7fc0b747d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:31.831 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.830+0000 7fc0b747d640 1 Processor -- start 2024-09-11T14:58:31.831 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.830+0000 7fc0b747d640 1 -- start start 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b747d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0b009f870 0x7fc0b009fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b747d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b0074b50 con 0x7fc0b00a01c0 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b747d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00a0c60 con 0x7fc0b009f870 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b5219640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0b009f870 0x7fc0b009fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b5219640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0b009f870 0x7fc0b009fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51544/0 (socket says 172.21.15.52:51544) 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b5219640 1 -- 172.21.15.52:0/805317847 learned_addr learned my addr 172.21.15.52:0/805317847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b5219640 1 -- 172.21.15.52:0/805317847 >> v1:172.21.15.52:6789/0 conn(0x7fc0b00a01c0 legacy=0x7fc0b01364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.832+0000 7fc0b5219640 1 -- 172.21.15.52:0/805317847 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b00a2110 con 0x7fc0b009f870 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.833+0000 7fc0b5219640 1 --2- 172.21.15.52:0/805317847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b009fc80 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12375af797be82f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:31.834 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.833+0000 7fc0a7fff640 1 -- 172.21.15.52:0/805317847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0ac009e40 con 0x7fc0b009f870 2024-09-11T14:58:31.835 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.833+0000 7fc0a7fff640 1 -- 172.21.15.52:0/805317847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0ac00e230 con 0x7fc0b009f870 2024-09-11T14:58:31.835 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.833+0000 7fc0a7fff640 1 -- 172.21.15.52:0/805317847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0ac00e4d0 con 0x7fc0b009f870 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.833+0000 7fc0b747d640 1 -- 172.21.15.52:0/805317847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 msgr2=0x7fc0b009fc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.833+0000 7fc0b747d640 1 --2- 172.21.15.52:0/805317847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b009fc80 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.834+0000 7fc0b747d640 1 -- 172.21.15.52:0/805317847 shutdown_connections 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.834+0000 7fc0b747d640 1 --2- 172.21.15.52:0/805317847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b009fc80 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.834+0000 7fc0b747d640 1 -- 172.21.15.52:0/805317847 >> 172.21.15.52:0/805317847 conn(0x7fc0b00a6270 msgr2=0x7fc0b00a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.834+0000 7fc0b747d640 1 -- 172.21.15.52:0/805317847 shutdown_connections 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.834+0000 7fc0b747d640 1 -- 172.21.15.52:0/805317847 wait complete. 2024-09-11T14:58:31.836 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.834+0000 7fc0b747d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:31.837 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.836+0000 7fc0b747d640 1 Processor -- start 2024-09-11T14:58:31.837 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.836+0000 7fc0b747d640 1 -- start start 2024-09-11T14:58:31.839 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.837+0000 7fc0b747d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b0133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.837+0000 7fc0b747d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0137060 con 0x7fc0b009f870 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.837+0000 7fc0b5219640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b0133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.837+0000 7fc0b5219640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b0133740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51556/0 (socket says 172.21.15.52:51556) 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.837+0000 7fc0b5219640 1 -- 172.21.15.52:0/3213151263 learned_addr learned my addr 172.21.15.52:0/3213151263 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0b5219640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b006f4e0 con 0x7fc0b009f870 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0b5219640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b0133740 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0ac00ed90 con 0x7fc0b009f870 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0ac015420 con 0x7fc0b009f870 2024-09-11T14:58:31.840 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b01374c0 con 0x7fc0b009f870 2024-09-11T14:58:31.841 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0ac0156c0 con 0x7fc0b009f870 2024-09-11T14:58:31.841 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.838+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b009f300 con 0x7fc0b009f870 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.839+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc0ac015870 con 0x7fc0b009f870 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.839+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b0134ef0 con 0x7fc0b009f870 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.839+0000 7fc0a5ffb640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc09403e960 0x7fc094040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.839+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(729..729 src has 412..729) ==== 4207+0+0 (crc 0 0 0) 0x7fc0ac051170 con 0x7fc0b009f870 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.840+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=730}) -- 0x7fc0940453f0 con 0x7fc0b009f870 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.840+0000 7fc0b4a18640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc09403e960 0x7fc094040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:31.842 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.840+0000 7fc0b4a18640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc09403e960 0x7fc094040e70 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:31.846 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:31.845+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc0ac014c60 con 0x7fc0b009f870 2024-09-11T14:58:32.034 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.033+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pool2": "44c281f7-10ec-4da5-9213-49ec274d2684", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc0b006f4e0 con 0x7fc0b009f870 2024-09-11T14:58:32.255 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.254+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pool2": "44c281f7-10ec-4da5-9213-49ec274d2684", "yes_i_really_really_mean_it": true}]=0 pool '44c281f7-10ec-4da5-9213-49ec274d2684' removed v730) ==== 248+0+0 (crc 0 0 0) 0x7fc0b006f4e0 con 0x7fc0b009f870 2024-09-11T14:58:32.255 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.254+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(730..730 src has 412..730) ==== 296+0+0 (crc 0 0 0) 0x7fc0ac012d80 con 0x7fc0b009f870 2024-09-11T14:58:32.256 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.254+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=731}) -- 0x7fc094046060 con 0x7fc0b009f870 2024-09-11T14:58:32.385 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.384+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pool2": "44c281f7-10ec-4da5-9213-49ec274d2684", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc0b006f4e0 con 0x7fc0b009f870 2024-09-11T14:58:32.386 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.385+0000 7fc0a5ffb640 1 -- 172.21.15.52:0/3213151263 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "44c281f7-10ec-4da5-9213-49ec274d2684", "pool2": "44c281f7-10ec-4da5-9213-49ec274d2684", "yes_i_really_really_mean_it": true}]=0 pool '44c281f7-10ec-4da5-9213-49ec274d2684' does not exist v730) ==== 255+0+0 (crc 0 0 0) 0x7fc0b006f4e0 con 0x7fc0b009f870 2024-09-11T14:58:32.386 INFO:tasks.workunit.client.0.smithi052.stderr:pool '44c281f7-10ec-4da5-9213-49ec274d2684' does not exist 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc09403e960 msgr2=0x7fc094040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc09403e960 0x7fc094040e70 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 msgr2=0x7fc0b0133740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b0133740 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 shutdown_connections 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fc09403e960 0x7fc094040e70 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:32.389 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 --2- 172.21.15.52:0/3213151263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b009f870 0x7fc0b0133740 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:32.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 >> 172.21.15.52:0/3213151263 conn(0x7fc0b00a6270 msgr2=0x7fc0b00726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:32.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 shutdown_connections 2024-09-11T14:58:32.390 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.387+0000 7fc0b747d640 1 -- 172.21.15.52:0/3213151263 wait complete. 2024-09-11T14:58:32.400 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph osd pool delete 96b90da5-7bb8-428c-a88c-95404cb5f515 96b90da5-7bb8-428c-a88c-95404cb5f515 --yes-i-really-really-mean-it 2024-09-11T14:58:32.505 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.494+0000 7f0b5f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:32.506 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.505+0000 7f0b5f6bd640 1 Processor -- start 2024-09-11T14:58:32.506 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.505+0000 7f0b5f6bd640 1 -- start start 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5f6bd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b58136fe0 0x7f0b5813b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5f6bd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b580a16a0 con 0x7f0b581364c0 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5f6bd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0b580a0a00 con 0x7f0b58136fe0 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5cc58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b58136fe0 0x7f0b5813b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5cc58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b58136fe0 0x7f0b5813b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51568/0 (socket says 172.21.15.52:51568) 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5cc58640 1 -- 172.21.15.52:0/838772055 learned_addr learned my addr 172.21.15.52:0/838772055 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5d459640 1 --1- 172.21.15.52:0/838772055 >> v1:172.21.15.52:6789/0 conn(0x7f0b581364c0 0x7f0b581368d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50682/0 (socket says 172.21.15.52:50682) 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5cc58640 1 -- 172.21.15.52:0/838772055 >> v1:172.21.15.52:6789/0 conn(0x7f0b581364c0 legacy=0x7f0b581368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b4bfff640 1 -- 172.21.15.52:0/838772055 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765049842 0 0) 0x7f0b580a16a0 con 0x7f0b581364c0 2024-09-11T14:58:32.509 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.507+0000 7f0b5cc58640 1 -- 172.21.15.52:0/838772055 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b580a13b0 con 0x7f0b58136fe0 2024-09-11T14:58:32.510 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.508+0000 7f0b5cc58640 1 --2- 172.21.15.52:0/838772055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b58136fe0 0x7f0b5813b700 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828b1d8cec57c18f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:32.510 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.508+0000 7f0b4bfff640 1 -- 172.21.15.52:0/838772055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b54009e50 con 0x7f0b58136fe0 2024-09-11T14:58:32.510 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.508+0000 7f0b4bfff640 1 -- 172.21.15.52:0/838772055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b5400e230 con 0x7f0b58136fe0 2024-09-11T14:58:32.510 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.508+0000 7f0b4bfff640 1 -- 172.21.15.52:0/838772055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b5400e4d0 con 0x7f0b58136fe0 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/838772055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b58136fe0 msgr2=0x7f0b5813b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 --2- 172.21.15.52:0/838772055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b58136fe0 0x7f0b5813b700 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/838772055 shutdown_connections 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 --2- 172.21.15.52:0/838772055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b58136fe0 0x7f0b5813b700 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/838772055 >> 172.21.15.52:0/838772055 conn(0x7f0b580a6270 msgr2=0x7f0b580a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/838772055 shutdown_connections 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/838772055 wait complete. 2024-09-11T14:58:32.511 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.509+0000 7f0b5f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:32.512 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.511+0000 7f0b5f6bd640 1 Processor -- start 2024-09-11T14:58:32.512 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.511+0000 7f0b5f6bd640 1 -- start start 2024-09-11T14:58:32.514 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.512+0000 7f0b5f6bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 0x7f0b581ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:32.515 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.512+0000 7f0b5f6bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b58134630 con 0x7f0b581364c0 2024-09-11T14:58:32.515 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b5d459640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 0x7f0b581ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:32.515 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b5d459640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 0x7f0b581ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51580/0 (socket says 172.21.15.52:51580) 2024-09-11T14:58:32.515 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b5d459640 1 -- 172.21.15.52:0/714753850 learned_addr learned my addr 172.21.15.52:0/714753850 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:32.516 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b5d459640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b58133a30 con 0x7f0b581364c0 2024-09-11T14:58:32.516 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b5d459640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 0x7f0b581ca7c0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:32.516 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b4c004b80 con 0x7f0b581364c0 2024-09-11T14:58:32.516 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b4c004ce0 con 0x7f0b581364c0 2024-09-11T14:58:32.516 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b58134860 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.513+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b4c007120 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.514+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b58135f20 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.515+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0b4c0072d0 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.515+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b580a2230 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.515+0000 7f0b49ffb640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0b3c03e930 0x7f0b3c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.515+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(730..730 src has 412..730) ==== 3819+0+0 (crc 0 0 0) 0x7f0b4c04fc20 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.515+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=731}) -- 0x7f0b3c044bc0 con 0x7f0b581364c0 2024-09-11T14:58:32.517 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.516+0000 7f0b5cc58640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0b3c03e930 0x7f0b3c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:32.518 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.516+0000 7f0b5cc58640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0b3c03e930 0x7f0b3c040e40 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:32.522 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.521+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0b4c00f420 con 0x7f0b581364c0 2024-09-11T14:58:32.713 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:32.711+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pool2": "96b90da5-7bb8-428c-a88c-95404cb5f515", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b58050fc0 con 0x7f0b581364c0 2024-09-11T14:58:33.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.262+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pool2": "96b90da5-7bb8-428c-a88c-95404cb5f515", "yes_i_really_really_mean_it": true}]=0 pool '96b90da5-7bb8-428c-a88c-95404cb5f515' removed v731) ==== 248+0+0 (crc 0 0 0) 0x7f0b4c00a0c0 con 0x7f0b581364c0 2024-09-11T14:58:33.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.262+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 8 ==== osd_map(731..731 src has 412..731) ==== 296+0+0 (crc 0 0 0) 0x7f0b4c021e70 con 0x7f0b581364c0 2024-09-11T14:58:33.263 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.262+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=732}) -- 0x7f0b3c045910 con 0x7f0b581364c0 2024-09-11T14:58:33.396 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.394+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pool2": "96b90da5-7bb8-428c-a88c-95404cb5f515", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b581353d0 con 0x7f0b581364c0 2024-09-11T14:58:33.396 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.395+0000 7f0b49ffb640 1 -- 172.21.15.52:0/714753850 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "96b90da5-7bb8-428c-a88c-95404cb5f515", "pool2": "96b90da5-7bb8-428c-a88c-95404cb5f515", "yes_i_really_really_mean_it": true}]=0 pool '96b90da5-7bb8-428c-a88c-95404cb5f515' does not exist v731) ==== 255+0+0 (crc 0 0 0) 0x7f0b4c00a7b0 con 0x7f0b581364c0 2024-09-11T14:58:33.396 INFO:tasks.workunit.client.0.smithi052.stderr:pool '96b90da5-7bb8-428c-a88c-95404cb5f515' does not exist 2024-09-11T14:58:33.399 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0b3c03e930 msgr2=0x7f0b3c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:33.399 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0b3c03e930 0x7f0b3c040e40 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 msgr2=0x7f0b581ca7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 0x7f0b581ca7c0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 shutdown_connections 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0b3c03e930 0x7f0b3c040e40 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 --2- 172.21.15.52:0/714753850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b581364c0 0x7f0b581ca7c0 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 >> 172.21.15.52:0/714753850 conn(0x7f0b580a6270 msgr2=0x7f0b58071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 shutdown_connections 2024-09-11T14:58:33.400 INFO:tasks.workunit.client.0.smithi052.stderr:2024-09-11T14:58:33.398+0000 7f0b5f6bd640 1 -- 172.21.15.52:0/714753850 wait complete. 2024-09-11T14:58:33.415 INFO:tasks.workunit.client.0.smithi052.stdout:OK 2024-09-11T14:58:33.416 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo OK 2024-09-11T14:58:33.417 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:58:33.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:58:33.485 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-11T14:58:33.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T14:58:33.840 DEBUG:teuthology.parallel:result is None 2024-09-11T14:58:33.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:58:33.866 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:58:33.866 DEBUG:teuthology.orchestra.run.smithi052:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:58:33.931 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:58:33.931 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T14:58:33.939 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:58:33.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:58:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.078+0000 7f035b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:34.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.083+0000 7f035b191640 1 Processor -- start 2024-09-11T14:58:34.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.084+0000 7f035b191640 1 -- start start 2024-09-11T14:58:34.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f035b191640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f035406f2d0 0x7f0354138e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f035b191640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f035409f270 con 0x7f035406e7b0 2024-09-11T14:58:34.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f035b191640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f035409ef60 con 0x7f035406f2d0 2024-09-11T14:58:34.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f0353fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f035406f2d0 0x7f0354138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f0353fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f035406f2d0 0x7f0354138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45198/0 (socket says 172.21.15.52:45198) 2024-09-11T14:58:34.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f0358f2d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f035406e7b0 0x7f035406ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48816/0 (socket says 172.21.15.52:48816) 2024-09-11T14:58:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.085+0000 7f0353fff640 1 -- 172.21.15.52:0/1258893408 learned_addr learned my addr 172.21.15.52:0/1258893408 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.086+0000 7f0353fff640 1 -- 172.21.15.52:0/1258893408 >> v1:172.21.15.52:6789/0 conn(0x7f035406e7b0 legacy=0x7f035406ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.086+0000 7f0353fff640 1 -- 172.21.15.52:0/1258893408 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035409e840 con 0x7f035406f2d0 2024-09-11T14:58:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.086+0000 7f0353fff640 1 --2- 172.21.15.52:0/1258893408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406f2d0 0x7f0354138e70 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1f01ad08d4d230 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.086+0000 7f03537fe640 1 -- 172.21.15.52:0/1258893408 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0348009e50 con 0x7f035406f2d0 2024-09-11T14:58:34.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.086+0000 7f03537fe640 1 -- 172.21.15.52:0/1258893408 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f034800e230 con 0x7f035406f2d0 2024-09-11T14:58:34.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.086+0000 7f03537fe640 1 -- 172.21.15.52:0/1258893408 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f034800e4d0 con 0x7f035406f2d0 2024-09-11T14:58:34.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 -- 172.21.15.52:0/1258893408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406f2d0 msgr2=0x7f0354138e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 --2- 172.21.15.52:0/1258893408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406f2d0 0x7f0354138e70 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 -- 172.21.15.52:0/1258893408 shutdown_connections 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 --2- 172.21.15.52:0/1258893408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406f2d0 0x7f0354138e70 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 -- 172.21.15.52:0/1258893408 >> 172.21.15.52:0/1258893408 conn(0x7f03540a40f0 msgr2=0x7f03540a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 -- 172.21.15.52:0/1258893408 shutdown_connections 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 1 -- 172.21.15.52:0/1258893408 wait complete. 2024-09-11T14:58:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.087+0000 7f035b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:34.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.089+0000 7f035b191640 1 Processor -- start 2024-09-11T14:58:34.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.089+0000 7f035b191640 1 -- start start 2024-09-11T14:58:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f035b191640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 0x7f0354122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f035b191640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0354133d40 con 0x7f035406e7b0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f0358f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 0x7f0354122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f0358f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 0x7f0354122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45202/0 (socket says 172.21.15.52:45202) 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f0358f2d640 1 -- 172.21.15.52:0/1251057211 learned_addr learned my addr 172.21.15.52:0/1251057211 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f0358f2d640 1 -- 172.21.15.52:0/1251057211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03541210c0 con 0x7f035406e7b0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f0358f2d640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 0x7f0354122800 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f03440059a0 con 0x7f035406e7b0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0344005b00 con 0x7f035406e7b0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0354133950 con 0x7f035406e7b0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0344005da0 con 0x7f035406e7b0 2024-09-11T14:58:34.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.091+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0354120760 con 0x7f035406e7b0 2024-09-11T14:58:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.092+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035406ebc0 con 0x7f035406e7b0 2024-09-11T14:58:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.092+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f03440070b0 con 0x7f035406e7b0 2024-09-11T14:58:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.093+0000 7f03517fa640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f034003e930 0x7f0340040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.093+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f034404f970 con 0x7f035406e7b0 2024-09-11T14:58:34.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.093+0000 7f0353fff640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f034003e930 0x7f0340040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.094+0000 7f0353fff640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f034003e930 0x7f0340040e40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.098+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f034400f230 con 0x7f035406e7b0 2024-09-11T14:58:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.286+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f035409e3f0 con 0x7f034003e930 2024-09-11T14:58:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.289+0000 7f03517fa640 1 -- 172.21.15.52:0/1251057211 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7f034800e4a0 con 0x7f034003e930 2024-09-11T14:58:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:58:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:58:34.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.291+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f034003e930 msgr2=0x7f0340040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.291+0000 7f035b191640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f034003e930 0x7f0340040e40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.291+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 msgr2=0x7f0354122800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.291+0000 7f035b191640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 0x7f0354122800 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.292+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 shutdown_connections 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.292+0000 7f035b191640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f034003e930 0x7f0340040e40 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.292+0000 7f035b191640 1 --2- 172.21.15.52:0/1251057211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f035406e7b0 0x7f0354122800 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.292+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 >> 172.21.15.52:0/1251057211 conn(0x7f03540a40f0 msgr2=0x7f0354070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.292+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 shutdown_connections 2024-09-11T14:58:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.292+0000 7f035b191640 1 -- 172.21.15.52:0/1251057211 wait complete. 2024-09-11T14:58:34.304 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1320,"stamp":"2024-09-11T14:58:33.263445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":29932,"kb_used_data":29932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209160980,"statfs":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066204"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.745088+0000","last_change":"2024-09-11T14:44:05.660844+0000","last_active":"2024-09-11T14:58:01.745088+0000","last_peered":"2024-09-11T14:58:01.745088+0000","last_clean":"2024-09-11T14:58:01.745088+0000","last_became_active":"2024-09-11T14:44:05.649994+0000","last_became_peered":"2024-09-11T14:44:05.649994+0000","last_unstale":"2024-09-11T14:58:01.745088+0000","last_undegraded":"2024-09-11T14:58:01.745088+0000","last_fullsized":"2024-09-11T14:58:01.745088+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746887+0000","last_change":"2024-09-11T14:44:05.854279+0000","last_active":"2024-09-11T14:58:01.746887+0000","last_peered":"2024-09-11T14:58:01.746887+0000","last_clean":"2024-09-11T14:58:01.746887+0000","last_became_active":"2024-09-11T14:44:05.824863+0000","last_became_peered":"2024-09-11T14:44:05.824863+0000","last_unstale":"2024-09-11T14:58:01.746887+0000","last_undegraded":"2024-09-11T14:58:01.746887+0000","last_fullsized":"2024-09-11T14:58:01.746887+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.741730+0000","last_change":"2024-09-11T14:44:05.713742+0000","last_active":"2024-09-11T14:58:01.741730+0000","last_peered":"2024-09-11T14:58:01.741730+0000","last_clean":"2024-09-11T14:58:01.741730+0000","last_became_active":"2024-09-11T14:44:05.683981+0000","last_became_peered":"2024-09-11T14:44:05.683981+0000","last_unstale":"2024-09-11T14:58:01.741730+0000","last_undegraded":"2024-09-11T14:58:01.741730+0000","last_fullsized":"2024-09-11T14:58:01.741730+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.732116+0000","last_change":"2024-09-11T14:44:05.723245+0000","last_active":"2024-09-11T14:58:01.732116+0000","last_peered":"2024-09-11T14:58:01.732116+0000","last_clean":"2024-09-11T14:58:01.732116+0000","last_became_active":"2024-09-11T14:44:05.701327+0000","last_became_peered":"2024-09-11T14:44:05.701327+0000","last_unstale":"2024-09-11T14:58:01.732116+0000","last_undegraded":"2024-09-11T14:58:01.732116+0000","last_fullsized":"2024-09-11T14:58:01.732116+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.749089+0000","last_change":"2024-09-11T14:44:05.751677+0000","last_active":"2024-09-11T14:58:01.749089+0000","last_peered":"2024-09-11T14:58:01.749089+0000","last_clean":"2024-09-11T14:58:01.749089+0000","last_became_active":"2024-09-11T14:44:05.705638+0000","last_became_peered":"2024-09-11T14:44:05.705638+0000","last_unstale":"2024-09-11T14:58:01.749089+0000","last_undegraded":"2024-09-11T14:58:01.749089+0000","last_fullsized":"2024-09-11T14:58:01.749089+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746593+0000","last_change":"2024-09-11T14:44:05.767557+0000","last_active":"2024-09-11T14:58:01.746593+0000","last_peered":"2024-09-11T14:58:01.746593+0000","last_clean":"2024-09-11T14:58:01.746593+0000","last_became_active":"2024-09-11T14:44:05.670460+0000","last_became_peered":"2024-09-11T14:44:05.670460+0000","last_unstale":"2024-09-11T14:58:01.746593+0000","last_undegraded":"2024-09-11T14:58:01.746593+0000","last_fullsized":"2024-09-11T14:58:01.746593+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.754069+0000","last_change":"2024-09-11T14:44:05.777597+0000","last_active":"2024-09-11T14:58:01.754069+0000","last_peered":"2024-09-11T14:58:01.754069+0000","last_clean":"2024-09-11T14:58:01.754069+0000","last_became_active":"2024-09-11T14:44:05.740371+0000","last_became_peered":"2024-09-11T14:44:05.740371+0000","last_unstale":"2024-09-11T14:58:01.754069+0000","last_undegraded":"2024-09-11T14:58:01.754069+0000","last_fullsized":"2024-09-11T14:58:01.754069+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.759968+0000","last_change":"2024-09-11T14:44:05.810163+0000","last_active":"2024-09-11T14:58:01.759968+0000","last_peered":"2024-09-11T14:58:01.759968+0000","last_clean":"2024-09-11T14:58:01.759968+0000","last_became_active":"2024-09-11T14:44:05.760501+0000","last_became_peered":"2024-09-11T14:44:05.760501+0000","last_unstale":"2024-09-11T14:58:01.759968+0000","last_undegraded":"2024-09-11T14:58:01.759968+0000","last_fullsized":"2024-09-11T14:58:01.759968+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733909+0000","last_change":"2024-09-11T14:44:05.731506+0000","last_active":"2024-09-11T14:58:01.733909+0000","last_peered":"2024-09-11T14:58:01.733909+0000","last_clean":"2024-09-11T14:58:01.733909+0000","last_became_active":"2024-09-11T14:44:05.710518+0000","last_became_peered":"2024-09-11T14:44:05.710518+0000","last_unstale":"2024-09-11T14:58:01.733909+0000","last_undegraded":"2024-09-11T14:58:01.733909+0000","last_fullsized":"2024-09-11T14:58:01.733909+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733936+0000","last_change":"2024-09-11T14:44:05.732559+0000","last_active":"2024-09-11T14:58:01.733936+0000","last_peered":"2024-09-11T14:58:01.733936+0000","last_clean":"2024-09-11T14:58:01.733936+0000","last_became_active":"2024-09-11T14:44:05.716117+0000","last_became_peered":"2024-09-11T14:44:05.716117+0000","last_unstale":"2024-09-11T14:58:01.733936+0000","last_undegraded":"2024-09-11T14:58:01.733936+0000","last_fullsized":"2024-09-11T14:58:01.733936+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733920+0000","last_change":"2024-09-11T14:44:05.819861+0000","last_active":"2024-09-11T14:58:01.733920+0000","last_peered":"2024-09-11T14:58:01.733920+0000","last_clean":"2024-09-11T14:58:01.733920+0000","last_became_active":"2024-09-11T14:44:05.809065+0000","last_became_peered":"2024-09-11T14:44:05.809065+0000","last_unstale":"2024-09-11T14:58:01.733920+0000","last_undegraded":"2024-09-11T14:58:01.733920+0000","last_fullsized":"2024-09-11T14:58:01.733920+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.740343+0000","last_change":"2024-09-11T14:44:05.878169+0000","last_active":"2024-09-11T14:58:01.740343+0000","last_peered":"2024-09-11T14:58:01.740343+0000","last_clean":"2024-09-11T14:58:01.740343+0000","last_became_active":"2024-09-11T14:44:05.807629+0000","last_became_peered":"2024-09-11T14:44:05.807629+0000","last_unstale":"2024-09-11T14:58:01.740343+0000","last_undegraded":"2024-09-11T14:58:01.740343+0000","last_fullsized":"2024-09-11T14:58:01.740343+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.729357+0000","last_change":"2024-09-11T14:44:05.932032+0000","last_active":"2024-09-11T14:58:01.729357+0000","last_peered":"2024-09-11T14:58:01.729357+0000","last_clean":"2024-09-11T14:58:01.729357+0000","last_became_active":"2024-09-11T14:44:05.923287+0000","last_became_peered":"2024-09-11T14:44:05.923287+0000","last_unstale":"2024-09-11T14:58:01.729357+0000","last_undegraded":"2024-09-11T14:58:01.729357+0000","last_fullsized":"2024-09-11T14:58:01.729357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.725553+0000","last_change":"2024-09-11T14:44:05.811005+0000","last_active":"2024-09-11T14:58:01.725553+0000","last_peered":"2024-09-11T14:58:01.725553+0000","last_clean":"2024-09-11T14:58:01.725553+0000","last_became_active":"2024-09-11T14:44:05.802531+0000","last_became_peered":"2024-09-11T14:44:05.802531+0000","last_unstale":"2024-09-11T14:58:01.725553+0000","last_undegraded":"2024-09-11T14:58:01.725553+0000","last_fullsized":"2024-09-11T14:58:01.725553+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.761596+0000","last_change":"2024-09-11T14:44:05.875259+0000","last_active":"2024-09-11T14:58:01.761596+0000","last_peered":"2024-09-11T14:58:01.761596+0000","last_clean":"2024-09-11T14:58:01.761596+0000","last_became_active":"2024-09-11T14:44:05.865190+0000","last_became_peered":"2024-09-11T14:44:05.865190+0000","last_unstale":"2024-09-11T14:58:01.761596+0000","last_undegraded":"2024-09-11T14:58:01.761596+0000","last_fullsized":"2024-09-11T14:58:01.761596+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.754787+0000","last_change":"2024-09-11T14:44:05.839001+0000","last_active":"2024-09-11T14:58:01.754787+0000","last_peered":"2024-09-11T14:58:01.754787+0000","last_clean":"2024-09-11T14:58:01.754787+0000","last_became_active":"2024-09-11T14:44:05.784807+0000","last_became_peered":"2024-09-11T14:44:05.784807+0000","last_unstale":"2024-09-11T14:58:01.754787+0000","last_undegraded":"2024-09-11T14:58:01.754787+0000","last_fullsized":"2024-09-11T14:58:01.754787+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.759071+0000","last_change":"2024-09-11T14:44:05.818455+0000","last_active":"2024-09-11T14:58:01.759071+0000","last_peered":"2024-09-11T14:58:01.759071+0000","last_clean":"2024-09-11T14:58:01.759071+0000","last_became_active":"2024-09-11T14:44:05.775468+0000","last_became_peered":"2024-09-11T14:44:05.775468+0000","last_unstale":"2024-09-11T14:58:01.759071+0000","last_undegraded":"2024-09-11T14:58:01.759071+0000","last_fullsized":"2024-09-11T14:58:01.759071+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.738708+0000","last_change":"2024-09-11T14:44:05.755511+0000","last_active":"2024-09-11T14:58:01.738708+0000","last_peered":"2024-09-11T14:58:01.738708+0000","last_clean":"2024-09-11T14:58:01.738708+0000","last_became_active":"2024-09-11T14:44:05.723386+0000","last_became_peered":"2024-09-11T14:44:05.723386+0000","last_unstale":"2024-09-11T14:58:01.738708+0000","last_undegraded":"2024-09-11T14:58:01.738708+0000","last_fullsized":"2024-09-11T14:58:01.738708+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.729575+0000","last_change":"2024-09-11T14:44:05.718878+0000","last_active":"2024-09-11T14:58:01.729575+0000","last_peered":"2024-09-11T14:58:01.729575+0000","last_clean":"2024-09-11T14:58:01.729575+0000","last_became_active":"2024-09-11T14:44:05.669284+0000","last_became_peered":"2024-09-11T14:44:05.669284+0000","last_unstale":"2024-09-11T14:58:01.729575+0000","last_undegraded":"2024-09-11T14:58:01.729575+0000","last_fullsized":"2024-09-11T14:58:01.729575+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.752118+0000","last_change":"2024-09-11T14:44:05.731456+0000","last_active":"2024-09-11T14:58:01.752118+0000","last_peered":"2024-09-11T14:58:01.752118+0000","last_clean":"2024-09-11T14:58:01.752118+0000","last_became_active":"2024-09-11T14:44:05.720000+0000","last_became_peered":"2024-09-11T14:44:05.720000+0000","last_unstale":"2024-09-11T14:58:01.752118+0000","last_undegraded":"2024-09-11T14:58:01.752118+0000","last_fullsized":"2024-09-11T14:58:01.752118+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.739615+0000","last_change":"2024-09-11T14:44:06.003807+0000","last_active":"2024-09-11T14:58:01.739615+0000","last_peered":"2024-09-11T14:58:01.739615+0000","last_clean":"2024-09-11T14:58:01.739615+0000","last_became_active":"2024-09-11T14:44:05.994115+0000","last_became_peered":"2024-09-11T14:44:05.994115+0000","last_unstale":"2024-09-11T14:58:01.739615+0000","last_undegraded":"2024-09-11T14:58:01.739615+0000","last_fullsized":"2024-09-11T14:58:01.739615+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.745884+0000","last_change":"2024-09-11T14:44:05.762950+0000","last_active":"2024-09-11T14:58:01.745884+0000","last_peered":"2024-09-11T14:58:01.745884+0000","last_clean":"2024-09-11T14:58:01.745884+0000","last_became_active":"2024-09-11T14:44:05.719555+0000","last_became_peered":"2024-09-11T14:44:05.719555+0000","last_unstale":"2024-09-11T14:58:01.745884+0000","last_undegraded":"2024-09-11T14:58:01.745884+0000","last_fullsized":"2024-09-11T14:58:01.745884+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.736178+0000","last_change":"2024-09-11T14:44:05.669658+0000","last_active":"2024-09-11T14:58:01.736178+0000","last_peered":"2024-09-11T14:58:01.736178+0000","last_clean":"2024-09-11T14:58:01.736178+0000","last_became_active":"2024-09-11T14:44:05.643040+0000","last_became_peered":"2024-09-11T14:44:05.643040+0000","last_unstale":"2024-09-11T14:58:01.736178+0000","last_undegraded":"2024-09-11T14:58:01.736178+0000","last_fullsized":"2024-09-11T14:58:01.736178+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.734671+0000","last_change":"2024-09-11T14:44:05.837046+0000","last_active":"2024-09-11T14:58:01.734671+0000","last_peered":"2024-09-11T14:58:01.734671+0000","last_clean":"2024-09-11T14:58:01.734671+0000","last_became_active":"2024-09-11T14:44:05.827738+0000","last_became_peered":"2024-09-11T14:44:05.827738+0000","last_unstale":"2024-09-11T14:58:01.734671+0000","last_undegraded":"2024-09-11T14:58:01.734671+0000","last_fullsized":"2024-09-11T14:58:01.734671+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.725026+0000","last_change":"2024-09-11T14:44:05.644371+0000","last_active":"2024-09-11T14:58:01.725026+0000","last_peered":"2024-09-11T14:58:01.725026+0000","last_clean":"2024-09-11T14:58:01.725026+0000","last_became_active":"2024-09-11T14:44:05.636002+0000","last_became_peered":"2024-09-11T14:44:05.636002+0000","last_unstale":"2024-09-11T14:58:01.725026+0000","last_undegraded":"2024-09-11T14:58:01.725026+0000","last_fullsized":"2024-09-11T14:58:01.725026+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.747274+0000","last_change":"2024-09-11T14:44:05.784078+0000","last_active":"2024-09-11T14:58:01.747274+0000","last_peered":"2024-09-11T14:58:01.747274+0000","last_clean":"2024-09-11T14:58:01.747274+0000","last_became_active":"2024-09-11T14:44:05.735069+0000","last_became_peered":"2024-09-11T14:44:05.735069+0000","last_unstale":"2024-09-11T14:58:01.747274+0000","last_undegraded":"2024-09-11T14:58:01.747274+0000","last_fullsized":"2024-09-11T14:58:01.747274+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.742223+0000","last_change":"2024-09-11T14:44:05.783552+0000","last_active":"2024-09-11T14:58:01.742223+0000","last_peered":"2024-09-11T14:58:01.742223+0000","last_clean":"2024-09-11T14:58:01.742223+0000","last_became_active":"2024-09-11T14:44:05.746996+0000","last_became_peered":"2024-09-11T14:44:05.746996+0000","last_unstale":"2024-09-11T14:58:01.742223+0000","last_undegraded":"2024-09-11T14:58:01.742223+0000","last_fullsized":"2024-09-11T14:58:01.742223+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.753902+0000","last_change":"2024-09-11T14:44:05.754862+0000","last_active":"2024-09-11T14:58:01.753902+0000","last_peered":"2024-09-11T14:58:01.753902+0000","last_clean":"2024-09-11T14:58:01.753902+0000","last_became_active":"2024-09-11T14:44:05.698451+0000","last_became_peered":"2024-09-11T14:44:05.698451+0000","last_unstale":"2024-09-11T14:58:01.753902+0000","last_undegraded":"2024-09-11T14:58:01.753902+0000","last_fullsized":"2024-09-11T14:58:01.753902+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.762508+0000","last_change":"2024-09-11T14:44:05.767263+0000","last_active":"2024-09-11T14:58:01.762508+0000","last_peered":"2024-09-11T14:58:01.762508+0000","last_clean":"2024-09-11T14:58:01.762508+0000","last_became_active":"2024-09-11T14:44:05.745807+0000","last_became_peered":"2024-09-11T14:44:05.745807+0000","last_unstale":"2024-09-11T14:58:01.762508+0000","last_undegraded":"2024-09-11T14:58:01.762508+0000","last_fullsized":"2024-09-11T14:58:01.762508+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743366+0000","last_change":"2024-09-11T14:44:05.892263+0000","last_active":"2024-09-11T14:58:01.743366+0000","last_peered":"2024-09-11T14:58:01.743366+0000","last_clean":"2024-09-11T14:58:01.743366+0000","last_became_active":"2024-09-11T14:44:05.775888+0000","last_became_peered":"2024-09-11T14:44:05.775888+0000","last_unstale":"2024-09-11T14:58:01.743366+0000","last_undegraded":"2024-09-11T14:58:01.743366+0000","last_fullsized":"2024-09-11T14:58:01.743366+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1485,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.744913+0000","last_change":"2024-09-11T14:44:05.711979+0000","last_active":"2024-09-11T14:58:01.744913+0000","last_peered":"2024-09-11T14:58:01.744913+0000","last_clean":"2024-09-11T14:58:01.744913+0000","last_became_active":"2024-09-11T14:44:05.661592+0000","last_became_peered":"2024-09-11T14:44:05.661592+0000","last_unstale":"2024-09-11T14:58:01.744913+0000","last_undegraded":"2024-09-11T14:58:01.744913+0000","last_fullsized":"2024-09-11T14:58:01.744913+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.742621+0000","last_change":"2024-09-11T14:44:05.737957+0000","last_active":"2024-09-11T14:58:01.742621+0000","last_peered":"2024-09-11T14:58:01.742621+0000","last_clean":"2024-09-11T14:58:01.742621+0000","last_became_active":"2024-09-11T14:44:05.719933+0000","last_became_peered":"2024-09-11T14:44:05.719933+0000","last_unstale":"2024-09-11T14:58:01.742621+0000","last_undegraded":"2024-09-11T14:58:01.742621+0000","last_fullsized":"2024-09-11T14:58:01.742621+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.748137+0000","last_change":"2024-09-11T14:38:50.697395+0000","last_active":"2024-09-11T14:58:01.748137+0000","last_peered":"2024-09-11T14:58:01.748137+0000","last_clean":"2024-09-11T14:58:01.748137+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:58:01.748137+0000","last_undegraded":"2024-09-11T14:58:01.748137+0000","last_fullsized":"2024-09-11T14:58:01.748137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743740+0000","last_change":"2024-09-11T14:38:50.696703+0000","last_active":"2024-09-11T14:58:01.743740+0000","last_peered":"2024-09-11T14:58:01.743740+0000","last_clean":"2024-09-11T14:58:01.743740+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:58:01.743740+0000","last_undegraded":"2024-09-11T14:58:01.743740+0000","last_fullsized":"2024-09-11T14:58:01.743740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.744183+0000","last_change":"2024-09-11T14:38:50.692528+0000","last_active":"2024-09-11T14:58:01.744183+0000","last_peered":"2024-09-11T14:58:01.744183+0000","last_clean":"2024-09-11T14:58:01.744183+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:58:01.744183+0000","last_undegraded":"2024-09-11T14:58:01.744183+0000","last_fullsized":"2024-09-11T14:58:01.744183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.731672+0000","last_change":"2024-09-11T14:38:50.691975+0000","last_active":"2024-09-11T14:58:01.731672+0000","last_peered":"2024-09-11T14:58:01.731672+0000","last_clean":"2024-09-11T14:58:01.731672+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:58:01.731672+0000","last_undegraded":"2024-09-11T14:58:01.731672+0000","last_fullsized":"2024-09-11T14:58:01.731672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746703+0000","last_change":"2024-09-11T14:38:50.693043+0000","last_active":"2024-09-11T14:58:01.746703+0000","last_peered":"2024-09-11T14:58:01.746703+0000","last_clean":"2024-09-11T14:58:01.746703+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:58:01.746703+0000","last_undegraded":"2024-09-11T14:58:01.746703+0000","last_fullsized":"2024-09-11T14:58:01.746703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743644+0000","last_change":"2024-09-11T14:38:50.691571+0000","last_active":"2024-09-11T14:58:01.743644+0000","last_peered":"2024-09-11T14:58:01.743644+0000","last_clean":"2024-09-11T14:58:01.743644+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:58:01.743644+0000","last_undegraded":"2024-09-11T14:58:01.743644+0000","last_fullsized":"2024-09-11T14:58:01.743644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2155,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.755678+0000","last_change":"2024-09-11T14:38:50.693770+0000","last_active":"2024-09-11T14:58:01.755678+0000","last_peered":"2024-09-11T14:58:01.755678+0000","last_clean":"2024-09-11T14:58:01.755678+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:58:01.755678+0000","last_undegraded":"2024-09-11T14:58:01.755678+0000","last_fullsized":"2024-09-11T14:58:01.755678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2158,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.750320+0000","last_change":"2024-09-11T14:38:50.697078+0000","last_active":"2024-09-11T14:58:01.750320+0000","last_peered":"2024-09-11T14:58:01.750320+0000","last_clean":"2024-09-11T14:58:01.750320+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:58:01.750320+0000","last_undegraded":"2024-09-11T14:58:01.750320+0000","last_fullsized":"2024-09-11T14:58:01.750320+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2229,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.731266+0000","last_change":"2024-09-11T14:38:46.649079+0000","last_active":"2024-09-11T14:58:01.731266+0000","last_peered":"2024-09-11T14:58:01.731266+0000","last_clean":"2024-09-11T14:58:01.731266+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:58:01.731266+0000","last_undegraded":"2024-09-11T14:58:01.731266+0000","last_fullsized":"2024-09-11T14:58:01.731266+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7864,"kb_used_data":7864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289864,"statfs":{"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6920,"kb_used_data":6920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290808,"statfs":{"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6748,"kb_used_data":6748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290980,"statfs":{"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8400,"kb_used_data":8400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289328,"statfs":{"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:58:34.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:58:34.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.415+0000 7fb7310c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:34.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.420+0000 7fb7310c8640 1 Processor -- start 2024-09-11T14:58:34.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.420+0000 7fb7310c8640 1 -- start start 2024-09-11T14:58:34.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb7310c8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb72c09e6c0 0x7fb72c09c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb7310c8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c074a70 con 0x7fb72c09cf20 2024-09-11T14:58:34.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb7310c8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c0a61f0 con 0x7fb72c09e6c0 2024-09-11T14:58:34.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb72ad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb72c09e6c0 0x7fb72c09c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb72259c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb72c09cf20 0x7fb72c133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48832/0 (socket says 172.21.15.52:48832) 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb72ad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb72c09e6c0 0x7fb72c09c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45208/0 (socket says 172.21.15.52:45208) 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.421+0000 7fb72259c640 1 -- 172.21.15.52:0/2780885378 learned_addr learned my addr 172.21.15.52:0/2780885378 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.422+0000 7fb72ad9d640 1 -- 172.21.15.52:0/2780885378 >> v1:172.21.15.52:6789/0 conn(0x7fb72c09cf20 legacy=0x7fb72c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.422+0000 7fb72ad9d640 1 -- 172.21.15.52:0/2780885378 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0a5ee0 con 0x7fb72c09e6c0 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.422+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/2780885378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09e6c0 0x7fb72c09c9e0 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb689ab3f3a6475 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.422+0000 7fb72a59c640 1 -- 172.21.15.52:0/2780885378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb71c009d80 con 0x7fb72c09e6c0 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.422+0000 7fb72a59c640 1 -- 172.21.15.52:0/2780885378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb71c00e230 con 0x7fb72c09e6c0 2024-09-11T14:58:34.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.422+0000 7fb72a59c640 1 -- 172.21.15.52:0/2780885378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb71c00e4d0 con 0x7fb72c09e6c0 2024-09-11T14:58:34.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 -- 172.21.15.52:0/2780885378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09e6c0 msgr2=0x7fb72c09c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 --2- 172.21.15.52:0/2780885378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09e6c0 0x7fb72c09c9e0 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 -- 172.21.15.52:0/2780885378 shutdown_connections 2024-09-11T14:58:34.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 --2- 172.21.15.52:0/2780885378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09e6c0 0x7fb72c09c9e0 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 -- 172.21.15.52:0/2780885378 >> 172.21.15.52:0/2780885378 conn(0x7fb72c0a43e0 msgr2=0x7fb72c073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:34.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 -- 172.21.15.52:0/2780885378 shutdown_connections 2024-09-11T14:58:34.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 1 -- 172.21.15.52:0/2780885378 wait complete. 2024-09-11T14:58:34.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.423+0000 7fb7310c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:34.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.425+0000 7fb7310c8640 1 Processor -- start 2024-09-11T14:58:34.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.425+0000 7fb7310c8640 1 -- start start 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb7310c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 0x7fb72c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb7310c8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c121180 con 0x7fb72c09cf20 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 0x7fb72c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 0x7fb72c1c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45220/0 (socket says 172.21.15.52:45220) 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb72ad9d640 1 -- 172.21.15.52:0/2021773423 learned_addr learned my addr 172.21.15.52:0/2021773423 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb72ad9d640 1 -- 172.21.15.52:0/2021773423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c11f670 con 0x7fb72c09cf20 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 0x7fb72c1c8570 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.427+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb71c014620 con 0x7fb72c09cf20 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.428+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb71c014780 con 0x7fb72c09cf20 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.428+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c133fa0 con 0x7fb72c09cf20 2024-09-11T14:58:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.428+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb71c014a20 con 0x7fb72c09cf20 2024-09-11T14:58:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.428+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c11f8a0 con 0x7fb72c09cf20 2024-09-11T14:58:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.429+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb71c014c20 con 0x7fb72c09cf20 2024-09-11T14:58:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.429+0000 7fb723fff640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb70c03e8e0 0x7fb70c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.429+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7fb71c019040 con 0x7fb72c09cf20 2024-09-11T14:58:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.429+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c09d6e0 con 0x7fb72c09cf20 2024-09-11T14:58:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.429+0000 7fb72259c640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb70c03e8e0 0x7fb70c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.430+0000 7fb72259c640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb70c03e8e0 0x7fb70c040df0 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.434+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb71c012580 con 0x7fb72c09cf20 2024-09-11T14:58:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.617+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb72c09d330 con 0x7fb70c03e8e0 2024-09-11T14:58:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.620+0000 7fb723fff640 1 -- 172.21.15.52:0/2021773423 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fb714005910 con 0x7fb70c03e8e0 2024-09-11T14:58:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:58:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb70c03e8e0 msgr2=0x7fb70c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb70c03e8e0 0x7fb70c040df0 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 msgr2=0x7fb72c1c8570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 0x7fb72c1c8570 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 shutdown_connections 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fb70c03e8e0 0x7fb70c040df0 unknown :-1 s=CLOSED pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 --2- 172.21.15.52:0/2021773423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c09cf20 0x7fb72c1c8570 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 >> 172.21.15.52:0/2021773423 conn(0x7fb72c0a43e0 msgr2=0x7fb72c1bbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 shutdown_connections 2024-09-11T14:58:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.622+0000 7fb7310c8640 1 -- 172.21.15.52:0/2021773423 wait complete. 2024-09-11T14:58:34.635 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1320,"stamp":"2024-09-11T14:58:33.263445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":29932,"kb_used_data":29932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209160980,"statfs":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066204"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.745088+0000","last_change":"2024-09-11T14:44:05.660844+0000","last_active":"2024-09-11T14:58:01.745088+0000","last_peered":"2024-09-11T14:58:01.745088+0000","last_clean":"2024-09-11T14:58:01.745088+0000","last_became_active":"2024-09-11T14:44:05.649994+0000","last_became_peered":"2024-09-11T14:44:05.649994+0000","last_unstale":"2024-09-11T14:58:01.745088+0000","last_undegraded":"2024-09-11T14:58:01.745088+0000","last_fullsized":"2024-09-11T14:58:01.745088+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746887+0000","last_change":"2024-09-11T14:44:05.854279+0000","last_active":"2024-09-11T14:58:01.746887+0000","last_peered":"2024-09-11T14:58:01.746887+0000","last_clean":"2024-09-11T14:58:01.746887+0000","last_became_active":"2024-09-11T14:44:05.824863+0000","last_became_peered":"2024-09-11T14:44:05.824863+0000","last_unstale":"2024-09-11T14:58:01.746887+0000","last_undegraded":"2024-09-11T14:58:01.746887+0000","last_fullsized":"2024-09-11T14:58:01.746887+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.741730+0000","last_change":"2024-09-11T14:44:05.713742+0000","last_active":"2024-09-11T14:58:01.741730+0000","last_peered":"2024-09-11T14:58:01.741730+0000","last_clean":"2024-09-11T14:58:01.741730+0000","last_became_active":"2024-09-11T14:44:05.683981+0000","last_became_peered":"2024-09-11T14:44:05.683981+0000","last_unstale":"2024-09-11T14:58:01.741730+0000","last_undegraded":"2024-09-11T14:58:01.741730+0000","last_fullsized":"2024-09-11T14:58:01.741730+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.732116+0000","last_change":"2024-09-11T14:44:05.723245+0000","last_active":"2024-09-11T14:58:01.732116+0000","last_peered":"2024-09-11T14:58:01.732116+0000","last_clean":"2024-09-11T14:58:01.732116+0000","last_became_active":"2024-09-11T14:44:05.701327+0000","last_became_peered":"2024-09-11T14:44:05.701327+0000","last_unstale":"2024-09-11T14:58:01.732116+0000","last_undegraded":"2024-09-11T14:58:01.732116+0000","last_fullsized":"2024-09-11T14:58:01.732116+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.749089+0000","last_change":"2024-09-11T14:44:05.751677+0000","last_active":"2024-09-11T14:58:01.749089+0000","last_peered":"2024-09-11T14:58:01.749089+0000","last_clean":"2024-09-11T14:58:01.749089+0000","last_became_active":"2024-09-11T14:44:05.705638+0000","last_became_peered":"2024-09-11T14:44:05.705638+0000","last_unstale":"2024-09-11T14:58:01.749089+0000","last_undegraded":"2024-09-11T14:58:01.749089+0000","last_fullsized":"2024-09-11T14:58:01.749089+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746593+0000","last_change":"2024-09-11T14:44:05.767557+0000","last_active":"2024-09-11T14:58:01.746593+0000","last_peered":"2024-09-11T14:58:01.746593+0000","last_clean":"2024-09-11T14:58:01.746593+0000","last_became_active":"2024-09-11T14:44:05.670460+0000","last_became_peered":"2024-09-11T14:44:05.670460+0000","last_unstale":"2024-09-11T14:58:01.746593+0000","last_undegraded":"2024-09-11T14:58:01.746593+0000","last_fullsized":"2024-09-11T14:58:01.746593+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.754069+0000","last_change":"2024-09-11T14:44:05.777597+0000","last_active":"2024-09-11T14:58:01.754069+0000","last_peered":"2024-09-11T14:58:01.754069+0000","last_clean":"2024-09-11T14:58:01.754069+0000","last_became_active":"2024-09-11T14:44:05.740371+0000","last_became_peered":"2024-09-11T14:44:05.740371+0000","last_unstale":"2024-09-11T14:58:01.754069+0000","last_undegraded":"2024-09-11T14:58:01.754069+0000","last_fullsized":"2024-09-11T14:58:01.754069+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.759968+0000","last_change":"2024-09-11T14:44:05.810163+0000","last_active":"2024-09-11T14:58:01.759968+0000","last_peered":"2024-09-11T14:58:01.759968+0000","last_clean":"2024-09-11T14:58:01.759968+0000","last_became_active":"2024-09-11T14:44:05.760501+0000","last_became_peered":"2024-09-11T14:44:05.760501+0000","last_unstale":"2024-09-11T14:58:01.759968+0000","last_undegraded":"2024-09-11T14:58:01.759968+0000","last_fullsized":"2024-09-11T14:58:01.759968+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733909+0000","last_change":"2024-09-11T14:44:05.731506+0000","last_active":"2024-09-11T14:58:01.733909+0000","last_peered":"2024-09-11T14:58:01.733909+0000","last_clean":"2024-09-11T14:58:01.733909+0000","last_became_active":"2024-09-11T14:44:05.710518+0000","last_became_peered":"2024-09-11T14:44:05.710518+0000","last_unstale":"2024-09-11T14:58:01.733909+0000","last_undegraded":"2024-09-11T14:58:01.733909+0000","last_fullsized":"2024-09-11T14:58:01.733909+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733936+0000","last_change":"2024-09-11T14:44:05.732559+0000","last_active":"2024-09-11T14:58:01.733936+0000","last_peered":"2024-09-11T14:58:01.733936+0000","last_clean":"2024-09-11T14:58:01.733936+0000","last_became_active":"2024-09-11T14:44:05.716117+0000","last_became_peered":"2024-09-11T14:44:05.716117+0000","last_unstale":"2024-09-11T14:58:01.733936+0000","last_undegraded":"2024-09-11T14:58:01.733936+0000","last_fullsized":"2024-09-11T14:58:01.733936+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733920+0000","last_change":"2024-09-11T14:44:05.819861+0000","last_active":"2024-09-11T14:58:01.733920+0000","last_peered":"2024-09-11T14:58:01.733920+0000","last_clean":"2024-09-11T14:58:01.733920+0000","last_became_active":"2024-09-11T14:44:05.809065+0000","last_became_peered":"2024-09-11T14:44:05.809065+0000","last_unstale":"2024-09-11T14:58:01.733920+0000","last_undegraded":"2024-09-11T14:58:01.733920+0000","last_fullsized":"2024-09-11T14:58:01.733920+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.740343+0000","last_change":"2024-09-11T14:44:05.878169+0000","last_active":"2024-09-11T14:58:01.740343+0000","last_peered":"2024-09-11T14:58:01.740343+0000","last_clean":"2024-09-11T14:58:01.740343+0000","last_became_active":"2024-09-11T14:44:05.807629+0000","last_became_peered":"2024-09-11T14:44:05.807629+0000","last_unstale":"2024-09-11T14:58:01.740343+0000","last_undegraded":"2024-09-11T14:58:01.740343+0000","last_fullsized":"2024-09-11T14:58:01.740343+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.729357+0000","last_change":"2024-09-11T14:44:05.932032+0000","last_active":"2024-09-11T14:58:01.729357+0000","last_peered":"2024-09-11T14:58:01.729357+0000","last_clean":"2024-09-11T14:58:01.729357+0000","last_became_active":"2024-09-11T14:44:05.923287+0000","last_became_peered":"2024-09-11T14:44:05.923287+0000","last_unstale":"2024-09-11T14:58:01.729357+0000","last_undegraded":"2024-09-11T14:58:01.729357+0000","last_fullsized":"2024-09-11T14:58:01.729357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.725553+0000","last_change":"2024-09-11T14:44:05.811005+0000","last_active":"2024-09-11T14:58:01.725553+0000","last_peered":"2024-09-11T14:58:01.725553+0000","last_clean":"2024-09-11T14:58:01.725553+0000","last_became_active":"2024-09-11T14:44:05.802531+0000","last_became_peered":"2024-09-11T14:44:05.802531+0000","last_unstale":"2024-09-11T14:58:01.725553+0000","last_undegraded":"2024-09-11T14:58:01.725553+0000","last_fullsized":"2024-09-11T14:58:01.725553+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.761596+0000","last_change":"2024-09-11T14:44:05.875259+0000","last_active":"2024-09-11T14:58:01.761596+0000","last_peered":"2024-09-11T14:58:01.761596+0000","last_clean":"2024-09-11T14:58:01.761596+0000","last_became_active":"2024-09-11T14:44:05.865190+0000","last_became_peered":"2024-09-11T14:44:05.865190+0000","last_unstale":"2024-09-11T14:58:01.761596+0000","last_undegraded":"2024-09-11T14:58:01.761596+0000","last_fullsized":"2024-09-11T14:58:01.761596+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.754787+0000","last_change":"2024-09-11T14:44:05.839001+0000","last_active":"2024-09-11T14:58:01.754787+0000","last_peered":"2024-09-11T14:58:01.754787+0000","last_clean":"2024-09-11T14:58:01.754787+0000","last_became_active":"2024-09-11T14:44:05.784807+0000","last_became_peered":"2024-09-11T14:44:05.784807+0000","last_unstale":"2024-09-11T14:58:01.754787+0000","last_undegraded":"2024-09-11T14:58:01.754787+0000","last_fullsized":"2024-09-11T14:58:01.754787+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.759071+0000","last_change":"2024-09-11T14:44:05.818455+0000","last_active":"2024-09-11T14:58:01.759071+0000","last_peered":"2024-09-11T14:58:01.759071+0000","last_clean":"2024-09-11T14:58:01.759071+0000","last_became_active":"2024-09-11T14:44:05.775468+0000","last_became_peered":"2024-09-11T14:44:05.775468+0000","last_unstale":"2024-09-11T14:58:01.759071+0000","last_undegraded":"2024-09-11T14:58:01.759071+0000","last_fullsized":"2024-09-11T14:58:01.759071+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.738708+0000","last_change":"2024-09-11T14:44:05.755511+0000","last_active":"2024-09-11T14:58:01.738708+0000","last_peered":"2024-09-11T14:58:01.738708+0000","last_clean":"2024-09-11T14:58:01.738708+0000","last_became_active":"2024-09-11T14:44:05.723386+0000","last_became_peered":"2024-09-11T14:44:05.723386+0000","last_unstale":"2024-09-11T14:58:01.738708+0000","last_undegraded":"2024-09-11T14:58:01.738708+0000","last_fullsized":"2024-09-11T14:58:01.738708+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.729575+0000","last_change":"2024-09-11T14:44:05.718878+0000","last_active":"2024-09-11T14:58:01.729575+0000","last_peered":"2024-09-11T14:58:01.729575+0000","last_clean":"2024-09-11T14:58:01.729575+0000","last_became_active":"2024-09-11T14:44:05.669284+0000","last_became_peered":"2024-09-11T14:44:05.669284+0000","last_unstale":"2024-09-11T14:58:01.729575+0000","last_undegraded":"2024-09-11T14:58:01.729575+0000","last_fullsized":"2024-09-11T14:58:01.729575+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.752118+0000","last_change":"2024-09-11T14:44:05.731456+0000","last_active":"2024-09-11T14:58:01.752118+0000","last_peered":"2024-09-11T14:58:01.752118+0000","last_clean":"2024-09-11T14:58:01.752118+0000","last_became_active":"2024-09-11T14:44:05.720000+0000","last_became_peered":"2024-09-11T14:44:05.720000+0000","last_unstale":"2024-09-11T14:58:01.752118+0000","last_undegraded":"2024-09-11T14:58:01.752118+0000","last_fullsized":"2024-09-11T14:58:01.752118+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.739615+0000","last_change":"2024-09-11T14:44:06.003807+0000","last_active":"2024-09-11T14:58:01.739615+0000","last_peered":"2024-09-11T14:58:01.739615+0000","last_clean":"2024-09-11T14:58:01.739615+0000","last_became_active":"2024-09-11T14:44:05.994115+0000","last_became_peered":"2024-09-11T14:44:05.994115+0000","last_unstale":"2024-09-11T14:58:01.739615+0000","last_undegraded":"2024-09-11T14:58:01.739615+0000","last_fullsized":"2024-09-11T14:58:01.739615+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.745884+0000","last_change":"2024-09-11T14:44:05.762950+0000","last_active":"2024-09-11T14:58:01.745884+0000","last_peered":"2024-09-11T14:58:01.745884+0000","last_clean":"2024-09-11T14:58:01.745884+0000","last_became_active":"2024-09-11T14:44:05.719555+0000","last_became_peered":"2024-09-11T14:44:05.719555+0000","last_unstale":"2024-09-11T14:58:01.745884+0000","last_undegraded":"2024-09-11T14:58:01.745884+0000","last_fullsized":"2024-09-11T14:58:01.745884+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.736178+0000","last_change":"2024-09-11T14:44:05.669658+0000","last_active":"2024-09-11T14:58:01.736178+0000","last_peered":"2024-09-11T14:58:01.736178+0000","last_clean":"2024-09-11T14:58:01.736178+0000","last_became_active":"2024-09-11T14:44:05.643040+0000","last_became_peered":"2024-09-11T14:44:05.643040+0000","last_unstale":"2024-09-11T14:58:01.736178+0000","last_undegraded":"2024-09-11T14:58:01.736178+0000","last_fullsized":"2024-09-11T14:58:01.736178+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.734671+0000","last_change":"2024-09-11T14:44:05.837046+0000","last_active":"2024-09-11T14:58:01.734671+0000","last_peered":"2024-09-11T14:58:01.734671+0000","last_clean":"2024-09-11T14:58:01.734671+0000","last_became_active":"2024-09-11T14:44:05.827738+0000","last_became_peered":"2024-09-11T14:44:05.827738+0000","last_unstale":"2024-09-11T14:58:01.734671+0000","last_undegraded":"2024-09-11T14:58:01.734671+0000","last_fullsized":"2024-09-11T14:58:01.734671+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.725026+0000","last_change":"2024-09-11T14:44:05.644371+0000","last_active":"2024-09-11T14:58:01.725026+0000","last_peered":"2024-09-11T14:58:01.725026+0000","last_clean":"2024-09-11T14:58:01.725026+0000","last_became_active":"2024-09-11T14:44:05.636002+0000","last_became_peered":"2024-09-11T14:44:05.636002+0000","last_unstale":"2024-09-11T14:58:01.725026+0000","last_undegraded":"2024-09-11T14:58:01.725026+0000","last_fullsized":"2024-09-11T14:58:01.725026+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.747274+0000","last_change":"2024-09-11T14:44:05.784078+0000","last_active":"2024-09-11T14:58:01.747274+0000","last_peered":"2024-09-11T14:58:01.747274+0000","last_clean":"2024-09-11T14:58:01.747274+0000","last_became_active":"2024-09-11T14:44:05.735069+0000","last_became_peered":"2024-09-11T14:44:05.735069+0000","last_unstale":"2024-09-11T14:58:01.747274+0000","last_undegraded":"2024-09-11T14:58:01.747274+0000","last_fullsized":"2024-09-11T14:58:01.747274+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.742223+0000","last_change":"2024-09-11T14:44:05.783552+0000","last_active":"2024-09-11T14:58:01.742223+0000","last_peered":"2024-09-11T14:58:01.742223+0000","last_clean":"2024-09-11T14:58:01.742223+0000","last_became_active":"2024-09-11T14:44:05.746996+0000","last_became_peered":"2024-09-11T14:44:05.746996+0000","last_unstale":"2024-09-11T14:58:01.742223+0000","last_undegraded":"2024-09-11T14:58:01.742223+0000","last_fullsized":"2024-09-11T14:58:01.742223+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.753902+0000","last_change":"2024-09-11T14:44:05.754862+0000","last_active":"2024-09-11T14:58:01.753902+0000","last_peered":"2024-09-11T14:58:01.753902+0000","last_clean":"2024-09-11T14:58:01.753902+0000","last_became_active":"2024-09-11T14:44:05.698451+0000","last_became_peered":"2024-09-11T14:44:05.698451+0000","last_unstale":"2024-09-11T14:58:01.753902+0000","last_undegraded":"2024-09-11T14:58:01.753902+0000","last_fullsized":"2024-09-11T14:58:01.753902+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.762508+0000","last_change":"2024-09-11T14:44:05.767263+0000","last_active":"2024-09-11T14:58:01.762508+0000","last_peered":"2024-09-11T14:58:01.762508+0000","last_clean":"2024-09-11T14:58:01.762508+0000","last_became_active":"2024-09-11T14:44:05.745807+0000","last_became_peered":"2024-09-11T14:44:05.745807+0000","last_unstale":"2024-09-11T14:58:01.762508+0000","last_undegraded":"2024-09-11T14:58:01.762508+0000","last_fullsized":"2024-09-11T14:58:01.762508+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743366+0000","last_change":"2024-09-11T14:44:05.892263+0000","last_active":"2024-09-11T14:58:01.743366+0000","last_peered":"2024-09-11T14:58:01.743366+0000","last_clean":"2024-09-11T14:58:01.743366+0000","last_became_active":"2024-09-11T14:44:05.775888+0000","last_became_peered":"2024-09-11T14:44:05.775888+0000","last_unstale":"2024-09-11T14:58:01.743366+0000","last_undegraded":"2024-09-11T14:58:01.743366+0000","last_fullsized":"2024-09-11T14:58:01.743366+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1485,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.744913+0000","last_change":"2024-09-11T14:44:05.711979+0000","last_active":"2024-09-11T14:58:01.744913+0000","last_peered":"2024-09-11T14:58:01.744913+0000","last_clean":"2024-09-11T14:58:01.744913+0000","last_became_active":"2024-09-11T14:44:05.661592+0000","last_became_peered":"2024-09-11T14:44:05.661592+0000","last_unstale":"2024-09-11T14:58:01.744913+0000","last_undegraded":"2024-09-11T14:58:01.744913+0000","last_fullsized":"2024-09-11T14:58:01.744913+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.742621+0000","last_change":"2024-09-11T14:44:05.737957+0000","last_active":"2024-09-11T14:58:01.742621+0000","last_peered":"2024-09-11T14:58:01.742621+0000","last_clean":"2024-09-11T14:58:01.742621+0000","last_became_active":"2024-09-11T14:44:05.719933+0000","last_became_peered":"2024-09-11T14:44:05.719933+0000","last_unstale":"2024-09-11T14:58:01.742621+0000","last_undegraded":"2024-09-11T14:58:01.742621+0000","last_fullsized":"2024-09-11T14:58:01.742621+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.748137+0000","last_change":"2024-09-11T14:38:50.697395+0000","last_active":"2024-09-11T14:58:01.748137+0000","last_peered":"2024-09-11T14:58:01.748137+0000","last_clean":"2024-09-11T14:58:01.748137+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:58:01.748137+0000","last_undegraded":"2024-09-11T14:58:01.748137+0000","last_fullsized":"2024-09-11T14:58:01.748137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743740+0000","last_change":"2024-09-11T14:38:50.696703+0000","last_active":"2024-09-11T14:58:01.743740+0000","last_peered":"2024-09-11T14:58:01.743740+0000","last_clean":"2024-09-11T14:58:01.743740+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:58:01.743740+0000","last_undegraded":"2024-09-11T14:58:01.743740+0000","last_fullsized":"2024-09-11T14:58:01.743740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.744183+0000","last_change":"2024-09-11T14:38:50.692528+0000","last_active":"2024-09-11T14:58:01.744183+0000","last_peered":"2024-09-11T14:58:01.744183+0000","last_clean":"2024-09-11T14:58:01.744183+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:58:01.744183+0000","last_undegraded":"2024-09-11T14:58:01.744183+0000","last_fullsized":"2024-09-11T14:58:01.744183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.731672+0000","last_change":"2024-09-11T14:38:50.691975+0000","last_active":"2024-09-11T14:58:01.731672+0000","last_peered":"2024-09-11T14:58:01.731672+0000","last_clean":"2024-09-11T14:58:01.731672+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:58:01.731672+0000","last_undegraded":"2024-09-11T14:58:01.731672+0000","last_fullsized":"2024-09-11T14:58:01.731672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746703+0000","last_change":"2024-09-11T14:38:50.693043+0000","last_active":"2024-09-11T14:58:01.746703+0000","last_peered":"2024-09-11T14:58:01.746703+0000","last_clean":"2024-09-11T14:58:01.746703+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:58:01.746703+0000","last_undegraded":"2024-09-11T14:58:01.746703+0000","last_fullsized":"2024-09-11T14:58:01.746703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743644+0000","last_change":"2024-09-11T14:38:50.691571+0000","last_active":"2024-09-11T14:58:01.743644+0000","last_peered":"2024-09-11T14:58:01.743644+0000","last_clean":"2024-09-11T14:58:01.743644+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:58:01.743644+0000","last_undegraded":"2024-09-11T14:58:01.743644+0000","last_fullsized":"2024-09-11T14:58:01.743644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2155,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.755678+0000","last_change":"2024-09-11T14:38:50.693770+0000","last_active":"2024-09-11T14:58:01.755678+0000","last_peered":"2024-09-11T14:58:01.755678+0000","last_clean":"2024-09-11T14:58:01.755678+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:58:01.755678+0000","last_undegraded":"2024-09-11T14:58:01.755678+0000","last_fullsized":"2024-09-11T14:58:01.755678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2158,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.750320+0000","last_change":"2024-09-11T14:38:50.697078+0000","last_active":"2024-09-11T14:58:01.750320+0000","last_peered":"2024-09-11T14:58:01.750320+0000","last_clean":"2024-09-11T14:58:01.750320+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:58:01.750320+0000","last_undegraded":"2024-09-11T14:58:01.750320+0000","last_fullsized":"2024-09-11T14:58:01.750320+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2229,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.731266+0000","last_change":"2024-09-11T14:38:46.649079+0000","last_active":"2024-09-11T14:58:01.731266+0000","last_peered":"2024-09-11T14:58:01.731266+0000","last_clean":"2024-09-11T14:58:01.731266+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:58:01.731266+0000","last_undegraded":"2024-09-11T14:58:01.731266+0000","last_fullsized":"2024-09-11T14:58:01.731266+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7864,"kb_used_data":7864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289864,"statfs":{"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6920,"kb_used_data":6920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290808,"statfs":{"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6748,"kb_used_data":6748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290980,"statfs":{"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8400,"kb_used_data":8400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289328,"statfs":{"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:58:34.637 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:58:34.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:58:34.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.744+0000 7f3b6a711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:34.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.750+0000 7f3b6a711640 1 Processor -- start 2024-09-11T14:58:34.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.750+0000 7f3b6a711640 1 -- start start 2024-09-11T14:58:34.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b6a711640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b6406e7b0 0x7f3b6406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b6a711640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6409da70 con 0x7f3b6406f100 2024-09-11T14:58:34.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b6a711640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6409eb60 con 0x7f3b6406e7b0 2024-09-11T14:58:34.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b63fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b6406e7b0 0x7f3b6406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b63fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b6406e7b0 0x7f3b6406ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45226/0 (socket says 172.21.15.52:45226) 2024-09-11T14:58:34.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b63fff640 1 -- 172.21.15.52:0/3527542822 learned_addr learned my addr 172.21.15.52:0/3527542822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.751+0000 7f3b637fe640 1 --1- 172.21.15.52:0/3527542822 >> v1:172.21.15.52:6789/0 conn(0x7f3b6406f100 0x7f3b64133a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48838/0 (socket says 172.21.15.52:48838) 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.752+0000 7f3b63fff640 1 -- 172.21.15.52:0/3527542822 >> v1:172.21.15.52:6789/0 conn(0x7f3b6406f100 legacy=0x7f3b64133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.752+0000 7f3b63fff640 1 -- 172.21.15.52:0/3527542822 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6409ef00 con 0x7f3b6406e7b0 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.752+0000 7f3b63fff640 1 --2- 172.21.15.52:0/3527542822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b6406ebc0 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8904709ce2e3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.752+0000 7f3b62ffd640 1 -- 172.21.15.52:0/3527542822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b54009e50 con 0x7f3b6406e7b0 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.752+0000 7f3b62ffd640 1 -- 172.21.15.52:0/3527542822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b5400e230 con 0x7f3b6406e7b0 2024-09-11T14:58:34.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.752+0000 7f3b62ffd640 1 -- 172.21.15.52:0/3527542822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b5400e4d0 con 0x7f3b6406e7b0 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 -- 172.21.15.52:0/3527542822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 msgr2=0x7f3b6406ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 --2- 172.21.15.52:0/3527542822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b6406ebc0 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 -- 172.21.15.52:0/3527542822 shutdown_connections 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 --2- 172.21.15.52:0/3527542822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b6406ebc0 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 -- 172.21.15.52:0/3527542822 >> 172.21.15.52:0/3527542822 conn(0x7f3b640a40f0 msgr2=0x7f3b640a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 -- 172.21.15.52:0/3527542822 shutdown_connections 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 1 -- 172.21.15.52:0/3527542822 wait complete. 2024-09-11T14:58:34.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.753+0000 7f3b6a711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:34.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.755+0000 7f3b6a711640 1 Processor -- start 2024-09-11T14:58:34.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.755+0000 7f3b6a711640 1 -- start start 2024-09-11T14:58:34.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.756+0000 7f3b6a711640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b64121510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.756+0000 7f3b6a711640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64122f90 con 0x7f3b6406e7b0 2024-09-11T14:58:34.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b64121510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b64121510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45238/0 (socket says 172.21.15.52:45238) 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b63fff640 1 -- 172.21.15.52:0/2711043918 learned_addr learned my addr 172.21.15.52:0/2711043918 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b63fff640 1 -- 172.21.15.52:0/2711043918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b64122750 con 0x7f3b6406e7b0 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b63fff640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b64121510 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b5400ede0 con 0x7f3b6406e7b0 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b54015420 con 0x7f3b6406e7b0 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b64123840 con 0x7f3b6406e7b0 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b540156c0 con 0x7f3b6406e7b0 2024-09-11T14:58:34.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.757+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b64123fc0 con 0x7f3b6406e7b0 2024-09-11T14:58:34.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.758+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3b54015870 con 0x7f3b6406e7b0 2024-09-11T14:58:34.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.758+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b641253e0 con 0x7f3b6406e7b0 2024-09-11T14:58:34.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.758+0000 7f3b60ff9640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3b5003e930 0x7f3b50040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:34.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.759+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f3b54051000 con 0x7f3b6406e7b0 2024-09-11T14:58:34.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.759+0000 7f3b637fe640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3b5003e930 0x7f3b50040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:34.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.759+0000 7f3b637fe640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3b5003e930 0x7f3b50040e40 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:34.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.764+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3b5400f2a0 con 0x7f3b6406e7b0 2024-09-11T14:58:34.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.950+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b64072770 con 0x7f3b5003e930 2024-09-11T14:58:34.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.953+0000 7f3b60ff9640 1 -- 172.21.15.52:0/2711043918 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7f3b64072770 con 0x7f3b5003e930 2024-09-11T14:58:34.954 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:58:34.955 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:58:34.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3b5003e930 msgr2=0x7f3b50040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3b5003e930 0x7f3b50040e40 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 msgr2=0x7f3b64121510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b64121510 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 shutdown_connections 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f3b5003e930 0x7f3b50040e40 unknown :-1 s=CLOSED pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 --2- 172.21.15.52:0/2711043918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b6406e7b0 0x7f3b64121510 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 >> 172.21.15.52:0/2711043918 conn(0x7f3b640a40f0 msgr2=0x7f3b64070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 shutdown_connections 2024-09-11T14:58:34.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:34.955+0000 7f3b6a711640 1 -- 172.21.15.52:0/2711043918 wait complete. 2024-09-11T14:58:34.968 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1320,"stamp":"2024-09-11T14:58:33.263445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":29932,"kb_used_data":29932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209160980,"statfs":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066204"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.745088+0000","last_change":"2024-09-11T14:44:05.660844+0000","last_active":"2024-09-11T14:58:01.745088+0000","last_peered":"2024-09-11T14:58:01.745088+0000","last_clean":"2024-09-11T14:58:01.745088+0000","last_became_active":"2024-09-11T14:44:05.649994+0000","last_became_peered":"2024-09-11T14:44:05.649994+0000","last_unstale":"2024-09-11T14:58:01.745088+0000","last_undegraded":"2024-09-11T14:58:01.745088+0000","last_fullsized":"2024-09-11T14:58:01.745088+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746887+0000","last_change":"2024-09-11T14:44:05.854279+0000","last_active":"2024-09-11T14:58:01.746887+0000","last_peered":"2024-09-11T14:58:01.746887+0000","last_clean":"2024-09-11T14:58:01.746887+0000","last_became_active":"2024-09-11T14:44:05.824863+0000","last_became_peered":"2024-09-11T14:44:05.824863+0000","last_unstale":"2024-09-11T14:58:01.746887+0000","last_undegraded":"2024-09-11T14:58:01.746887+0000","last_fullsized":"2024-09-11T14:58:01.746887+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.741730+0000","last_change":"2024-09-11T14:44:05.713742+0000","last_active":"2024-09-11T14:58:01.741730+0000","last_peered":"2024-09-11T14:58:01.741730+0000","last_clean":"2024-09-11T14:58:01.741730+0000","last_became_active":"2024-09-11T14:44:05.683981+0000","last_became_peered":"2024-09-11T14:44:05.683981+0000","last_unstale":"2024-09-11T14:58:01.741730+0000","last_undegraded":"2024-09-11T14:58:01.741730+0000","last_fullsized":"2024-09-11T14:58:01.741730+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.732116+0000","last_change":"2024-09-11T14:44:05.723245+0000","last_active":"2024-09-11T14:58:01.732116+0000","last_peered":"2024-09-11T14:58:01.732116+0000","last_clean":"2024-09-11T14:58:01.732116+0000","last_became_active":"2024-09-11T14:44:05.701327+0000","last_became_peered":"2024-09-11T14:44:05.701327+0000","last_unstale":"2024-09-11T14:58:01.732116+0000","last_undegraded":"2024-09-11T14:58:01.732116+0000","last_fullsized":"2024-09-11T14:58:01.732116+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.749089+0000","last_change":"2024-09-11T14:44:05.751677+0000","last_active":"2024-09-11T14:58:01.749089+0000","last_peered":"2024-09-11T14:58:01.749089+0000","last_clean":"2024-09-11T14:58:01.749089+0000","last_became_active":"2024-09-11T14:44:05.705638+0000","last_became_peered":"2024-09-11T14:44:05.705638+0000","last_unstale":"2024-09-11T14:58:01.749089+0000","last_undegraded":"2024-09-11T14:58:01.749089+0000","last_fullsized":"2024-09-11T14:58:01.749089+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746593+0000","last_change":"2024-09-11T14:44:05.767557+0000","last_active":"2024-09-11T14:58:01.746593+0000","last_peered":"2024-09-11T14:58:01.746593+0000","last_clean":"2024-09-11T14:58:01.746593+0000","last_became_active":"2024-09-11T14:44:05.670460+0000","last_became_peered":"2024-09-11T14:44:05.670460+0000","last_unstale":"2024-09-11T14:58:01.746593+0000","last_undegraded":"2024-09-11T14:58:01.746593+0000","last_fullsized":"2024-09-11T14:58:01.746593+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.754069+0000","last_change":"2024-09-11T14:44:05.777597+0000","last_active":"2024-09-11T14:58:01.754069+0000","last_peered":"2024-09-11T14:58:01.754069+0000","last_clean":"2024-09-11T14:58:01.754069+0000","last_became_active":"2024-09-11T14:44:05.740371+0000","last_became_peered":"2024-09-11T14:44:05.740371+0000","last_unstale":"2024-09-11T14:58:01.754069+0000","last_undegraded":"2024-09-11T14:58:01.754069+0000","last_fullsized":"2024-09-11T14:58:01.754069+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.759968+0000","last_change":"2024-09-11T14:44:05.810163+0000","last_active":"2024-09-11T14:58:01.759968+0000","last_peered":"2024-09-11T14:58:01.759968+0000","last_clean":"2024-09-11T14:58:01.759968+0000","last_became_active":"2024-09-11T14:44:05.760501+0000","last_became_peered":"2024-09-11T14:44:05.760501+0000","last_unstale":"2024-09-11T14:58:01.759968+0000","last_undegraded":"2024-09-11T14:58:01.759968+0000","last_fullsized":"2024-09-11T14:58:01.759968+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733909+0000","last_change":"2024-09-11T14:44:05.731506+0000","last_active":"2024-09-11T14:58:01.733909+0000","last_peered":"2024-09-11T14:58:01.733909+0000","last_clean":"2024-09-11T14:58:01.733909+0000","last_became_active":"2024-09-11T14:44:05.710518+0000","last_became_peered":"2024-09-11T14:44:05.710518+0000","last_unstale":"2024-09-11T14:58:01.733909+0000","last_undegraded":"2024-09-11T14:58:01.733909+0000","last_fullsized":"2024-09-11T14:58:01.733909+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733936+0000","last_change":"2024-09-11T14:44:05.732559+0000","last_active":"2024-09-11T14:58:01.733936+0000","last_peered":"2024-09-11T14:58:01.733936+0000","last_clean":"2024-09-11T14:58:01.733936+0000","last_became_active":"2024-09-11T14:44:05.716117+0000","last_became_peered":"2024-09-11T14:44:05.716117+0000","last_unstale":"2024-09-11T14:58:01.733936+0000","last_undegraded":"2024-09-11T14:58:01.733936+0000","last_fullsized":"2024-09-11T14:58:01.733936+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.733920+0000","last_change":"2024-09-11T14:44:05.819861+0000","last_active":"2024-09-11T14:58:01.733920+0000","last_peered":"2024-09-11T14:58:01.733920+0000","last_clean":"2024-09-11T14:58:01.733920+0000","last_became_active":"2024-09-11T14:44:05.809065+0000","last_became_peered":"2024-09-11T14:44:05.809065+0000","last_unstale":"2024-09-11T14:58:01.733920+0000","last_undegraded":"2024-09-11T14:58:01.733920+0000","last_fullsized":"2024-09-11T14:58:01.733920+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.740343+0000","last_change":"2024-09-11T14:44:05.878169+0000","last_active":"2024-09-11T14:58:01.740343+0000","last_peered":"2024-09-11T14:58:01.740343+0000","last_clean":"2024-09-11T14:58:01.740343+0000","last_became_active":"2024-09-11T14:44:05.807629+0000","last_became_peered":"2024-09-11T14:44:05.807629+0000","last_unstale":"2024-09-11T14:58:01.740343+0000","last_undegraded":"2024-09-11T14:58:01.740343+0000","last_fullsized":"2024-09-11T14:58:01.740343+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.729357+0000","last_change":"2024-09-11T14:44:05.932032+0000","last_active":"2024-09-11T14:58:01.729357+0000","last_peered":"2024-09-11T14:58:01.729357+0000","last_clean":"2024-09-11T14:58:01.729357+0000","last_became_active":"2024-09-11T14:44:05.923287+0000","last_became_peered":"2024-09-11T14:44:05.923287+0000","last_unstale":"2024-09-11T14:58:01.729357+0000","last_undegraded":"2024-09-11T14:58:01.729357+0000","last_fullsized":"2024-09-11T14:58:01.729357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.725553+0000","last_change":"2024-09-11T14:44:05.811005+0000","last_active":"2024-09-11T14:58:01.725553+0000","last_peered":"2024-09-11T14:58:01.725553+0000","last_clean":"2024-09-11T14:58:01.725553+0000","last_became_active":"2024-09-11T14:44:05.802531+0000","last_became_peered":"2024-09-11T14:44:05.802531+0000","last_unstale":"2024-09-11T14:58:01.725553+0000","last_undegraded":"2024-09-11T14:58:01.725553+0000","last_fullsized":"2024-09-11T14:58:01.725553+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.761596+0000","last_change":"2024-09-11T14:44:05.875259+0000","last_active":"2024-09-11T14:58:01.761596+0000","last_peered":"2024-09-11T14:58:01.761596+0000","last_clean":"2024-09-11T14:58:01.761596+0000","last_became_active":"2024-09-11T14:44:05.865190+0000","last_became_peered":"2024-09-11T14:44:05.865190+0000","last_unstale":"2024-09-11T14:58:01.761596+0000","last_undegraded":"2024-09-11T14:58:01.761596+0000","last_fullsized":"2024-09-11T14:58:01.761596+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.754787+0000","last_change":"2024-09-11T14:44:05.839001+0000","last_active":"2024-09-11T14:58:01.754787+0000","last_peered":"2024-09-11T14:58:01.754787+0000","last_clean":"2024-09-11T14:58:01.754787+0000","last_became_active":"2024-09-11T14:44:05.784807+0000","last_became_peered":"2024-09-11T14:44:05.784807+0000","last_unstale":"2024-09-11T14:58:01.754787+0000","last_undegraded":"2024-09-11T14:58:01.754787+0000","last_fullsized":"2024-09-11T14:58:01.754787+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.759071+0000","last_change":"2024-09-11T14:44:05.818455+0000","last_active":"2024-09-11T14:58:01.759071+0000","last_peered":"2024-09-11T14:58:01.759071+0000","last_clean":"2024-09-11T14:58:01.759071+0000","last_became_active":"2024-09-11T14:44:05.775468+0000","last_became_peered":"2024-09-11T14:44:05.775468+0000","last_unstale":"2024-09-11T14:58:01.759071+0000","last_undegraded":"2024-09-11T14:58:01.759071+0000","last_fullsized":"2024-09-11T14:58:01.759071+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.738708+0000","last_change":"2024-09-11T14:44:05.755511+0000","last_active":"2024-09-11T14:58:01.738708+0000","last_peered":"2024-09-11T14:58:01.738708+0000","last_clean":"2024-09-11T14:58:01.738708+0000","last_became_active":"2024-09-11T14:44:05.723386+0000","last_became_peered":"2024-09-11T14:44:05.723386+0000","last_unstale":"2024-09-11T14:58:01.738708+0000","last_undegraded":"2024-09-11T14:58:01.738708+0000","last_fullsized":"2024-09-11T14:58:01.738708+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.729575+0000","last_change":"2024-09-11T14:44:05.718878+0000","last_active":"2024-09-11T14:58:01.729575+0000","last_peered":"2024-09-11T14:58:01.729575+0000","last_clean":"2024-09-11T14:58:01.729575+0000","last_became_active":"2024-09-11T14:44:05.669284+0000","last_became_peered":"2024-09-11T14:44:05.669284+0000","last_unstale":"2024-09-11T14:58:01.729575+0000","last_undegraded":"2024-09-11T14:58:01.729575+0000","last_fullsized":"2024-09-11T14:58:01.729575+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.752118+0000","last_change":"2024-09-11T14:44:05.731456+0000","last_active":"2024-09-11T14:58:01.752118+0000","last_peered":"2024-09-11T14:58:01.752118+0000","last_clean":"2024-09-11T14:58:01.752118+0000","last_became_active":"2024-09-11T14:44:05.720000+0000","last_became_peered":"2024-09-11T14:44:05.720000+0000","last_unstale":"2024-09-11T14:58:01.752118+0000","last_undegraded":"2024-09-11T14:58:01.752118+0000","last_fullsized":"2024-09-11T14:58:01.752118+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.739615+0000","last_change":"2024-09-11T14:44:06.003807+0000","last_active":"2024-09-11T14:58:01.739615+0000","last_peered":"2024-09-11T14:58:01.739615+0000","last_clean":"2024-09-11T14:58:01.739615+0000","last_became_active":"2024-09-11T14:44:05.994115+0000","last_became_peered":"2024-09-11T14:44:05.994115+0000","last_unstale":"2024-09-11T14:58:01.739615+0000","last_undegraded":"2024-09-11T14:58:01.739615+0000","last_fullsized":"2024-09-11T14:58:01.739615+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.745884+0000","last_change":"2024-09-11T14:44:05.762950+0000","last_active":"2024-09-11T14:58:01.745884+0000","last_peered":"2024-09-11T14:58:01.745884+0000","last_clean":"2024-09-11T14:58:01.745884+0000","last_became_active":"2024-09-11T14:44:05.719555+0000","last_became_peered":"2024-09-11T14:44:05.719555+0000","last_unstale":"2024-09-11T14:58:01.745884+0000","last_undegraded":"2024-09-11T14:58:01.745884+0000","last_fullsized":"2024-09-11T14:58:01.745884+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.736178+0000","last_change":"2024-09-11T14:44:05.669658+0000","last_active":"2024-09-11T14:58:01.736178+0000","last_peered":"2024-09-11T14:58:01.736178+0000","last_clean":"2024-09-11T14:58:01.736178+0000","last_became_active":"2024-09-11T14:44:05.643040+0000","last_became_peered":"2024-09-11T14:44:05.643040+0000","last_unstale":"2024-09-11T14:58:01.736178+0000","last_undegraded":"2024-09-11T14:58:01.736178+0000","last_fullsized":"2024-09-11T14:58:01.736178+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.734671+0000","last_change":"2024-09-11T14:44:05.837046+0000","last_active":"2024-09-11T14:58:01.734671+0000","last_peered":"2024-09-11T14:58:01.734671+0000","last_clean":"2024-09-11T14:58:01.734671+0000","last_became_active":"2024-09-11T14:44:05.827738+0000","last_became_peered":"2024-09-11T14:44:05.827738+0000","last_unstale":"2024-09-11T14:58:01.734671+0000","last_undegraded":"2024-09-11T14:58:01.734671+0000","last_fullsized":"2024-09-11T14:58:01.734671+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.725026+0000","last_change":"2024-09-11T14:44:05.644371+0000","last_active":"2024-09-11T14:58:01.725026+0000","last_peered":"2024-09-11T14:58:01.725026+0000","last_clean":"2024-09-11T14:58:01.725026+0000","last_became_active":"2024-09-11T14:44:05.636002+0000","last_became_peered":"2024-09-11T14:44:05.636002+0000","last_unstale":"2024-09-11T14:58:01.725026+0000","last_undegraded":"2024-09-11T14:58:01.725026+0000","last_fullsized":"2024-09-11T14:58:01.725026+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.747274+0000","last_change":"2024-09-11T14:44:05.784078+0000","last_active":"2024-09-11T14:58:01.747274+0000","last_peered":"2024-09-11T14:58:01.747274+0000","last_clean":"2024-09-11T14:58:01.747274+0000","last_became_active":"2024-09-11T14:44:05.735069+0000","last_became_peered":"2024-09-11T14:44:05.735069+0000","last_unstale":"2024-09-11T14:58:01.747274+0000","last_undegraded":"2024-09-11T14:58:01.747274+0000","last_fullsized":"2024-09-11T14:58:01.747274+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.742223+0000","last_change":"2024-09-11T14:44:05.783552+0000","last_active":"2024-09-11T14:58:01.742223+0000","last_peered":"2024-09-11T14:58:01.742223+0000","last_clean":"2024-09-11T14:58:01.742223+0000","last_became_active":"2024-09-11T14:44:05.746996+0000","last_became_peered":"2024-09-11T14:44:05.746996+0000","last_unstale":"2024-09-11T14:58:01.742223+0000","last_undegraded":"2024-09-11T14:58:01.742223+0000","last_fullsized":"2024-09-11T14:58:01.742223+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.753902+0000","last_change":"2024-09-11T14:44:05.754862+0000","last_active":"2024-09-11T14:58:01.753902+0000","last_peered":"2024-09-11T14:58:01.753902+0000","last_clean":"2024-09-11T14:58:01.753902+0000","last_became_active":"2024-09-11T14:44:05.698451+0000","last_became_peered":"2024-09-11T14:44:05.698451+0000","last_unstale":"2024-09-11T14:58:01.753902+0000","last_undegraded":"2024-09-11T14:58:01.753902+0000","last_fullsized":"2024-09-11T14:58:01.753902+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.762508+0000","last_change":"2024-09-11T14:44:05.767263+0000","last_active":"2024-09-11T14:58:01.762508+0000","last_peered":"2024-09-11T14:58:01.762508+0000","last_clean":"2024-09-11T14:58:01.762508+0000","last_became_active":"2024-09-11T14:44:05.745807+0000","last_became_peered":"2024-09-11T14:44:05.745807+0000","last_unstale":"2024-09-11T14:58:01.762508+0000","last_undegraded":"2024-09-11T14:58:01.762508+0000","last_fullsized":"2024-09-11T14:58:01.762508+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743366+0000","last_change":"2024-09-11T14:44:05.892263+0000","last_active":"2024-09-11T14:58:01.743366+0000","last_peered":"2024-09-11T14:58:01.743366+0000","last_clean":"2024-09-11T14:58:01.743366+0000","last_became_active":"2024-09-11T14:44:05.775888+0000","last_became_peered":"2024-09-11T14:44:05.775888+0000","last_unstale":"2024-09-11T14:58:01.743366+0000","last_undegraded":"2024-09-11T14:58:01.743366+0000","last_fullsized":"2024-09-11T14:58:01.743366+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1485,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.744913+0000","last_change":"2024-09-11T14:44:05.711979+0000","last_active":"2024-09-11T14:58:01.744913+0000","last_peered":"2024-09-11T14:58:01.744913+0000","last_clean":"2024-09-11T14:58:01.744913+0000","last_became_active":"2024-09-11T14:44:05.661592+0000","last_became_peered":"2024-09-11T14:44:05.661592+0000","last_unstale":"2024-09-11T14:58:01.744913+0000","last_undegraded":"2024-09-11T14:58:01.744913+0000","last_fullsized":"2024-09-11T14:58:01.744913+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1472,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.742621+0000","last_change":"2024-09-11T14:44:05.737957+0000","last_active":"2024-09-11T14:58:01.742621+0000","last_peered":"2024-09-11T14:58:01.742621+0000","last_clean":"2024-09-11T14:58:01.742621+0000","last_became_active":"2024-09-11T14:44:05.719933+0000","last_became_peered":"2024-09-11T14:44:05.719933+0000","last_unstale":"2024-09-11T14:58:01.742621+0000","last_undegraded":"2024-09-11T14:58:01.742621+0000","last_fullsized":"2024-09-11T14:58:01.742621+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.748137+0000","last_change":"2024-09-11T14:38:50.697395+0000","last_active":"2024-09-11T14:58:01.748137+0000","last_peered":"2024-09-11T14:58:01.748137+0000","last_clean":"2024-09-11T14:58:01.748137+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:58:01.748137+0000","last_undegraded":"2024-09-11T14:58:01.748137+0000","last_fullsized":"2024-09-11T14:58:01.748137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743740+0000","last_change":"2024-09-11T14:38:50.696703+0000","last_active":"2024-09-11T14:58:01.743740+0000","last_peered":"2024-09-11T14:58:01.743740+0000","last_clean":"2024-09-11T14:58:01.743740+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:58:01.743740+0000","last_undegraded":"2024-09-11T14:58:01.743740+0000","last_fullsized":"2024-09-11T14:58:01.743740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.744183+0000","last_change":"2024-09-11T14:38:50.692528+0000","last_active":"2024-09-11T14:58:01.744183+0000","last_peered":"2024-09-11T14:58:01.744183+0000","last_clean":"2024-09-11T14:58:01.744183+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:58:01.744183+0000","last_undegraded":"2024-09-11T14:58:01.744183+0000","last_fullsized":"2024-09-11T14:58:01.744183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.731672+0000","last_change":"2024-09-11T14:38:50.691975+0000","last_active":"2024-09-11T14:58:01.731672+0000","last_peered":"2024-09-11T14:58:01.731672+0000","last_clean":"2024-09-11T14:58:01.731672+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:58:01.731672+0000","last_undegraded":"2024-09-11T14:58:01.731672+0000","last_fullsized":"2024-09-11T14:58:01.731672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.746703+0000","last_change":"2024-09-11T14:38:50.693043+0000","last_active":"2024-09-11T14:58:01.746703+0000","last_peered":"2024-09-11T14:58:01.746703+0000","last_clean":"2024-09-11T14:58:01.746703+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:58:01.746703+0000","last_undegraded":"2024-09-11T14:58:01.746703+0000","last_fullsized":"2024-09-11T14:58:01.746703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2157,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.743644+0000","last_change":"2024-09-11T14:38:50.691571+0000","last_active":"2024-09-11T14:58:01.743644+0000","last_peered":"2024-09-11T14:58:01.743644+0000","last_clean":"2024-09-11T14:58:01.743644+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:58:01.743644+0000","last_undegraded":"2024-09-11T14:58:01.743644+0000","last_fullsized":"2024-09-11T14:58:01.743644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2155,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.755678+0000","last_change":"2024-09-11T14:38:50.693770+0000","last_active":"2024-09-11T14:58:01.755678+0000","last_peered":"2024-09-11T14:58:01.755678+0000","last_clean":"2024-09-11T14:58:01.755678+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:58:01.755678+0000","last_undegraded":"2024-09-11T14:58:01.755678+0000","last_fullsized":"2024-09-11T14:58:01.755678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2158,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.750320+0000","last_change":"2024-09-11T14:38:50.697078+0000","last_active":"2024-09-11T14:58:01.750320+0000","last_peered":"2024-09-11T14:58:01.750320+0000","last_clean":"2024-09-11T14:58:01.750320+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:58:01.750320+0000","last_undegraded":"2024-09-11T14:58:01.750320+0000","last_fullsized":"2024-09-11T14:58:01.750320+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2229,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:58:01.731266+0000","last_change":"2024-09-11T14:38:46.649079+0000","last_active":"2024-09-11T14:58:01.731266+0000","last_peered":"2024-09-11T14:58:01.731266+0000","last_clean":"2024-09-11T14:58:01.731266+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:58:01.731266+0000","last_undegraded":"2024-09-11T14:58:01.731266+0000","last_fullsized":"2024-09-11T14:58:01.731266+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180843520,"internally_reserved":0,"allocated":30650368,"data_stored":30650368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7864,"kb_used_data":7864,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289864,"statfs":{"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6920,"kb_used_data":6920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290808,"statfs":{"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6748,"kb_used_data":6748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290980,"statfs":{"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8400,"kb_used_data":8400,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289328,"statfs":{"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53544271872,"internally_reserved":0,"allocated":8601600,"data_stored":8601600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53545963520,"internally_reserved":0,"allocated":6909952,"data_stored":6909952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53545787392,"internally_reserved":0,"allocated":7086080,"data_stored":7086080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53544820736,"internally_reserved":0,"allocated":8052736,"data_stored":8052736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:58:34.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:58:35.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.078+0000 7f0ef544f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:35.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.083+0000 7f0ef544f640 1 Processor -- start 2024-09-11T14:58:35.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.083+0000 7f0ef544f640 1 -- start start 2024-09-11T14:58:35.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0ef544f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ef0132b90 0x7f0ef01375a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:35.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0ef544f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef006ed70 con 0x7f0ef0132070 2024-09-11T14:58:35.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0ef544f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef006fce0 con 0x7f0ef0132b90 2024-09-11T14:58:35.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eeeffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ef0132070 0x7f0ef0132480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48844/0 (socket says 172.21.15.52:48844) 2024-09-11T14:58:35.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eeeffd640 1 -- 172.21.15.52:0/3124838812 learned_addr learned my addr 172.21.15.52:0/3124838812 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:35.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eee7fc640 1 --2- 172.21.15.52:0/3124838812 >> v2:172.21.15.52:3300/0 conn(0x7f0ef0132b90 0x7f0ef01375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eee7fc640 1 -- 172.21.15.52:0/3124838812 >> v1:172.21.15.52:6789/0 conn(0x7f0ef0132070 legacy=0x7f0ef0132480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eedffb640 1 -- 172.21.15.52:0/3124838812 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843542467 0 0) 0x7f0ef006ed70 con 0x7f0ef0132070 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eee7fc640 1 -- 172.21.15.52:0/3124838812 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef006f010 con 0x7f0ef0132b90 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eee7fc640 1 --2- 172.21.15.52:0/3124838812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132b90 0x7f0ef01375a0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eea5925fb5cea68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.085+0000 7f0eedffb640 1 -- 172.21.15.52:0/3124838812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ee400aea0 con 0x7f0ef0132b90 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0eedffb640 1 -- 172.21.15.52:0/3124838812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0ee400f230 con 0x7f0ef0132b90 2024-09-11T14:58:35.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0eedffb640 1 -- 172.21.15.52:0/3124838812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ee400f4d0 con 0x7f0ef0132b90 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 -- 172.21.15.52:0/3124838812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132b90 msgr2=0x7f0ef01375a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 --2- 172.21.15.52:0/3124838812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132b90 0x7f0ef01375a0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 -- 172.21.15.52:0/3124838812 shutdown_connections 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 --2- 172.21.15.52:0/3124838812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132b90 0x7f0ef01375a0 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 -- 172.21.15.52:0/3124838812 >> 172.21.15.52:0/3124838812 conn(0x7f0ef00a3320 msgr2=0x7f0ef00a3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 -- 172.21.15.52:0/3124838812 shutdown_connections 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.086+0000 7f0ef544f640 1 -- 172.21.15.52:0/3124838812 wait complete. 2024-09-11T14:58:35.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.087+0000 7f0ef544f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:35.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.088+0000 7f0ef544f640 1 Processor -- start 2024-09-11T14:58:35.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.089+0000 7f0ef544f640 1 -- start start 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.090+0000 7f0ef544f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 0x7f0ef01ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.090+0000 7f0ef544f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef00703d0 con 0x7f0ef0132070 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.090+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 0x7f0ef01ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.090+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 0x7f0ef01ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45244/0 (socket says 172.21.15.52:45244) 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.090+0000 7f0eeeffd640 1 -- 172.21.15.52:0/3898054185 learned_addr learned my addr 172.21.15.52:0/3898054185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0eeeffd640 1 -- 172.21.15.52:0/3898054185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef0073b20 con 0x7f0ef0132070 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0eeeffd640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 0x7f0ef01ca6a0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:35.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ee0004b80 con 0x7f0ef0132070 2024-09-11T14:58:35.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0ee0004ce0 con 0x7f0ef0132070 2024-09-11T14:58:35.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef00700a0 con 0x7f0ef0132070 2024-09-11T14:58:35.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ee0007120 con 0x7f0ef0132070 2024-09-11T14:58:35.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.091+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef0124a30 con 0x7f0ef0132070 2024-09-11T14:58:35.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.092+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0ee00072d0 con 0x7f0ef0132070 2024-09-11T14:58:35.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.092+0000 7f0ed77fe640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0edc03e930 0x7f0edc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:35.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.092+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef0132480 con 0x7f0ef0132070 2024-09-11T14:58:35.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.092+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f0ee004f8a0 con 0x7f0ef0132070 2024-09-11T14:58:35.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.093+0000 7f0eee7fc640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0edc03e930 0x7f0edc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:35.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.093+0000 7f0eee7fc640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0edc03e930 0x7f0edc040e40 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:35.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.098+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0ee0021f50 con 0x7f0ef0132070 2024-09-11T14:58:35.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.282+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ef0073b20 con 0x7f0ef0132070 2024-09-11T14:58:35.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.283+0000 7f0ed77fe640 1 -- 172.21.15.52:0/3898054185 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v731) ==== 74+0+11279 (crc 0 0 0) 0x7f0ef0073b20 con 0x7f0ef0132070 2024-09-11T14:58:35.284 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:58:35.284 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":731,"fsid":"a6b5d4a4-66d9-4a76-9e4a-eb916006be26","created":"2024-09-11T14:38:36.445816+0000","modified":"2024-09-11T14:58:33.259654+0000","last_up_change":"2024-09-11T14:38:43.548076+0000","last_in_change":"2024-09-11T14:38:38.572455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:38:44.937773+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:38:46.777496+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-11T14:44:03.573974+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"242","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2ba10be-8405-43e0-bf6c-00ee6c90d481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":718,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6807","nonce":1907008724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1907008724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1907008724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1907008724}]},"public_addr":"172.21.15.52:6807/1907008724","cluster_addr":"172.21.15.52:6806/1907008724","heartbeat_back_addr":"172.21.15.52:6808/1907008724","heartbeat_front_addr":"172.21.15.52:6800/1907008724","state":["exists","up"]},{"osd":1,"uuid":"88407485-bd36-46fd-9dcb-611a3f99f4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":718,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4284075780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6801","nonce":4284075780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6805","nonce":4284075780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":4284075780}]},"public_addr":"172.21.15.52:6802/4284075780","cluster_addr":"172.21.15.52:6801/4284075780","heartbeat_back_addr":"172.21.15.52:6805/4284075780","heartbeat_front_addr":"172.21.15.52:6804/4284075780","state":["exists","up"]},{"osd":2,"uuid":"46f85cbf-34b9-4cf9-9cb7-6390b1b37448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":718,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2099775818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6809","nonce":2099775818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2099775818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6819","nonce":2099775818}]},"public_addr":"172.21.15.143:6808/2099775818","cluster_addr":"172.21.15.143:6809/2099775818","heartbeat_back_addr":"172.21.15.143:6820/2099775818","heartbeat_front_addr":"172.21.15.143:6819/2099775818","state":["exists","up"]},{"osd":3,"uuid":"578c9a69-f18b-4318-9428-c582ab58eb18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":718,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6803","nonce":3147275988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":3147275988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3147275988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6807","nonce":3147275988}]},"public_addr":"172.21.15.143:6803/3147275988","cluster_addr":"172.21.15.143:6802/3147275988","heartbeat_back_addr":"172.21.15.143:6810/3147275988","heartbeat_front_addr":"172.21.15.143:6807/3147275988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:58:35.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0edc03e930 msgr2=0x7f0edc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:35.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0edc03e930 0x7f0edc040e40 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:35.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 msgr2=0x7f0ef01ca6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:35.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 0x7f0ef01ca6a0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:35.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 shutdown_connections 2024-09-11T14:58:35.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f0edc03e930 0x7f0edc040e40 unknown :-1 s=CLOSED pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:35.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 --2- 172.21.15.52:0/3898054185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ef0132070 0x7f0ef01ca6a0 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:35.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 >> 172.21.15.52:0/3898054185 conn(0x7f0ef00a3320 msgr2=0x7f0ef009f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:35.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 shutdown_connections 2024-09-11T14:58:35.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:35.285+0000 7f0ef544f640 1 -- 172.21.15.52:0/3898054185 wait complete. 2024-09-11T14:58:36.298 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T14:58:36.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:58:36.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.421+0000 7f999b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:36.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.430+0000 7f999b591640 1 Processor -- start 2024-09-11T14:58:36.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.431+0000 7f999b591640 1 -- start start 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f999b591640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f999406eec0 0x7f9994138e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f999b591640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99940a4dc0 con 0x7f999409dca0 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f999b591640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f99940a4ab0 con 0x7f999406eec0 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f9998b2c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f999406eec0 0x7f9994138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f9998b2c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f999406eec0 0x7f9994138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45250/0 (socket says 172.21.15.52:45250) 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f999932d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f999409dca0 0x7f999406e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48854/0 (socket says 172.21.15.52:48854) 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.432+0000 7f9998b2c640 1 -- 172.21.15.52:0/3727035578 learned_addr learned my addr 172.21.15.52:0/3727035578 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:36.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.433+0000 7f9998b2c640 1 -- 172.21.15.52:0/3727035578 >> v1:172.21.15.52:6789/0 conn(0x7f999409dca0 legacy=0x7f999406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.433+0000 7f9998b2c640 1 -- 172.21.15.52:0/3727035578 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999409ef50 con 0x7f999406eec0 2024-09-11T14:58:36.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.433+0000 7f9998b2c640 1 --2- 172.21.15.52:0/3727035578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f9994138e70 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398b0b66c907bf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.433+0000 7f998bfff640 1 -- 172.21.15.52:0/3727035578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9984009e50 con 0x7f999406eec0 2024-09-11T14:58:36.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.433+0000 7f998bfff640 1 -- 172.21.15.52:0/3727035578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f998400e230 con 0x7f999406eec0 2024-09-11T14:58:36.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.433+0000 7f998bfff640 1 -- 172.21.15.52:0/3727035578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f998400e4d0 con 0x7f999406eec0 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 -- 172.21.15.52:0/3727035578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 msgr2=0x7f9994138e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 --2- 172.21.15.52:0/3727035578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f9994138e70 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 -- 172.21.15.52:0/3727035578 shutdown_connections 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 --2- 172.21.15.52:0/3727035578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f9994138e70 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 -- 172.21.15.52:0/3727035578 >> 172.21.15.52:0/3727035578 conn(0x7f99940a39b0 msgr2=0x7f99940a3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 -- 172.21.15.52:0/3727035578 shutdown_connections 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 1 -- 172.21.15.52:0/3727035578 wait complete. 2024-09-11T14:58:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.434+0000 7f999b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:36.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.436+0000 7f999b591640 1 Processor -- start 2024-09-11T14:58:36.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.436+0000 7f999b591640 1 -- start start 2024-09-11T14:58:36.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999b591640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f99941229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999b591640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9994133970 con 0x7f999406eec0 2024-09-11T14:58:36.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999932d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f99941229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999932d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f99941229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45264/0 (socket says 172.21.15.52:45264) 2024-09-11T14:58:36.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999932d640 1 -- 172.21.15.52:0/3082462270 learned_addr learned my addr 172.21.15.52:0/3082462270 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:36.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999932d640 1 -- 172.21.15.52:0/3082462270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9994121270 con 0x7f999406eec0 2024-09-11T14:58:36.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.438+0000 7f999932d640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f99941229b0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.439+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f99900059a0 con 0x7f999406eec0 2024-09-11T14:58:36.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.439+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9990005b00 con 0x7f999406eec0 2024-09-11T14:58:36.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.439+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9994121b20 con 0x7f999406eec0 2024-09-11T14:58:36.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.439+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9990005da0 con 0x7f999406eec0 2024-09-11T14:58:36.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.439+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9994122090 con 0x7f999406eec0 2024-09-11T14:58:36.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9994133800 con 0x7f999406eec0 2024-09-11T14:58:36.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f99900070b0 con 0x7f999406eec0 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9989ffb640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f997803e930 0x7f9978040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f999004f970 con 0x7f999406eec0 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9989ffb640 1 --2- 172.21.15.52:0/3082462270 >> v2:172.21.15.52:6807/1907008724 conn(0x7f9978044a70 0x7f9978046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 --> v2:172.21.15.52:6807/1907008724 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99780475f0 con 0x7f9978044a70 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=731) ==== 24+0+0 (crc 0 0 0) 0x7f999004fd80 con 0x7f999406eec0 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.440+0000 7f9998b2c640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f997803e930 0x7f9978040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.441+0000 7f9998b2c640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f997803e930 0x7f9978040e40 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.441+0000 7f9999b2e640 1 --2- 172.21.15.52:0/3082462270 >> v2:172.21.15.52:6807/1907008724 conn(0x7f9978044a70 0x7f9978046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:58:36.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.445+0000 7f9999b2e640 1 --2- 172.21.15.52:0/3082462270 >> v2:172.21.15.52:6807/1907008724 conn(0x7f9978044a70 0x7f9978046f60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.447+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== osd.0 v2:172.21.15.52:6807/1907008724 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f99780475f0 con 0x7f9978044a70 2024-09-11T14:58:36.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.450+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 --> v2:172.21.15.52:6807/1907008724 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9994122340 con 0x7f9978044a70 2024-09-11T14:58:36.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f9989ffb640 1 -- 172.21.15.52:0/3082462270 <== osd.0 v2:172.21.15.52:6807/1907008724 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f9994122340 con 0x7f9978044a70 2024-09-11T14:58:36.453 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T14:58:36.453 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "" 2024-09-11T14:58:36.453 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T14:58:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 >> v2:172.21.15.52:6807/1907008724 conn(0x7f9978044a70 msgr2=0x7f9978046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 --2- 172.21.15.52:0/3082462270 >> v2:172.21.15.52:6807/1907008724 conn(0x7f9978044a70 0x7f9978046f60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f997803e930 msgr2=0x7f9978040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f997803e930 0x7f9978040e40 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 msgr2=0x7f99941229b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f99941229b0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 shutdown_connections 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 --2- 172.21.15.52:0/3082462270 >> v2:172.21.15.52:6807/1907008724 conn(0x7f9978044a70 0x7f9978046f60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f997803e930 0x7f9978040e40 unknown :-1 s=CLOSED pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 --2- 172.21.15.52:0/3082462270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f999406eec0 0x7f99941229b0 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 >> 172.21.15.52:0/3082462270 conn(0x7f99940a39b0 msgr2=0x7f99940707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 shutdown_connections 2024-09-11T14:58:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.452+0000 7f999b591640 1 -- 172.21.15.52:0/3082462270 wait complete. 2024-09-11T14:58:36.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T14:58:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.572+0000 7f2a04d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:36.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.579+0000 7f2a04d51640 1 Processor -- start 2024-09-11T14:58:36.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.579+0000 7f2a04d51640 1 -- start start 2024-09-11T14:58:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f2a04d51640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2a0009d9f0 0x7f2a00138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f2a04d51640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000745c0 con 0x7f2a00133b30 2024-09-11T14:58:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f2a04d51640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0009e280 con 0x7f2a0009d9f0 2024-09-11T14:58:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f29fe59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2a00133b30 0x7f2a00133f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48866/0 (socket says 172.21.15.52:48866) 2024-09-11T14:58:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f29fe59c640 1 -- 172.21.15.52:0/444870770 learned_addr learned my addr 172.21.15.52:0/444870770 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f29fdd9b640 1 --2- 172.21.15.52:0/444870770 >> v2:172.21.15.52:3300/0 conn(0x7f2a0009d9f0 0x7f2a00138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f29fdd9b640 1 -- 172.21.15.52:0/444870770 >> v1:172.21.15.52:6789/0 conn(0x7f2a00133b30 legacy=0x7f2a00133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f29fdd9b640 1 -- 172.21.15.52:0/444870770 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0009df70 con 0x7f2a0009d9f0 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.581+0000 7f29fdd9b640 1 --2- 172.21.15.52:0/444870770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a00138f80 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fce971c4913ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f29fd59a640 1 -- 172.21.15.52:0/444870770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f29f4009d90 con 0x7f2a0009d9f0 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f29fd59a640 1 -- 172.21.15.52:0/444870770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f29f400e230 con 0x7f2a0009d9f0 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f29fd59a640 1 -- 172.21.15.52:0/444870770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f29f400e4d0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f2a04d51640 1 -- 172.21.15.52:0/444870770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 msgr2=0x7f2a00138f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f2a04d51640 1 --2- 172.21.15.52:0/444870770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a00138f80 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f2a04d51640 1 -- 172.21.15.52:0/444870770 shutdown_connections 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f2a04d51640 1 --2- 172.21.15.52:0/444870770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a00138f80 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.582+0000 7f2a04d51640 1 -- 172.21.15.52:0/444870770 >> 172.21.15.52:0/444870770 conn(0x7f2a000a42e0 msgr2=0x7f2a00073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.583+0000 7f2a04d51640 1 -- 172.21.15.52:0/444870770 shutdown_connections 2024-09-11T14:58:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.583+0000 7f2a04d51640 1 -- 172.21.15.52:0/444870770 wait complete. 2024-09-11T14:58:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.583+0000 7f2a04d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.585+0000 7f2a04d51640 1 Processor -- start 2024-09-11T14:58:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.585+0000 7f2a04d51640 1 -- start start 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.586+0000 7f2a04d51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a0006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.586+0000 7f2a04d51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00126190 con 0x7f2a0009d9f0 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.586+0000 7f29fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a0006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.586+0000 7f29fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a0006f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45286/0 (socket says 172.21.15.52:45286) 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.586+0000 7f29fe59c640 1 -- 172.21.15.52:0/596753330 learned_addr learned my addr 172.21.15.52:0/596753330 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f29fe59c640 1 -- 172.21.15.52:0/596753330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a00125090 con 0x7f2a0009d9f0 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f29fe59c640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a0006f8c0 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f29f0005a60 con 0x7f2a0009d9f0 2024-09-11T14:58:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a000712a0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f29f0005bc0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f29f0005e60 con 0x7f2a0009d9f0 2024-09-11T14:58:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.587+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a00126380 con 0x7f2a0009d9f0 2024-09-11T14:58:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.588+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f29f00070b0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.588+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a001265d0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.588+0000 7f29eeffd640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f29e003e8e0 0x7f29e0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.588+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f29f004f9b0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.589+0000 7f29fdd9b640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f29e003e8e0 0x7f29e0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.589+0000 7f29fdd9b640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f29e003e8e0 0x7f29e0040df0 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.593+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2a001265d0 con 0x7f2a0009d9f0 2024-09-11T14:58:36.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.784+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2a00134bb0 con 0x7f29e003e8e0 2024-09-11T14:58:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.785+0000 7f29eeffd640 1 -- 172.21.15.52:0/596753330 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f2a00134bb0 con 0x7f29e003e8e0 2024-09-11T14:58:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T14:58:36.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f29e003e8e0 msgr2=0x7f29e0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f29e003e8e0 0x7f29e0040df0 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 msgr2=0x7f2a0006f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a0006f8c0 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 shutdown_connections 2024-09-11T14:58:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f29e003e8e0 0x7f29e0040df0 unknown :-1 s=CLOSED pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 --2- 172.21.15.52:0/596753330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0009d9f0 0x7f2a0006f8c0 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 >> 172.21.15.52:0/596753330 conn(0x7f2a000a42e0 msgr2=0x7f2a00071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 shutdown_connections 2024-09-11T14:58:36.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.787+0000 7f2a04d51640 1 -- 172.21.15.52:0/596753330 wait complete. 2024-09-11T14:58:36.804 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T14:58:36.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:58:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.925+0000 7f2beaf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.935+0000 7f2beaf91640 1 Processor -- start 2024-09-11T14:58:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.935+0000 7f2beaf91640 1 -- start start 2024-09-11T14:58:36.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2beaf91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2be4073d10 0x7f2be413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2beaf91640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be406f940 con 0x7f2be40731f0 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2beaf91640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2be4070f90 con 0x7f2be4073d10 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2be4073d10 0x7f2be413b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be8d2d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2be40731f0 0x7f2be4073600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48868/0 (socket says 172.21.15.52:48868) 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be8d2d640 1 -- 172.21.15.52:0/1292325125 learned_addr learned my addr 172.21.15.52:0/1292325125 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be3fff640 1 -- 172.21.15.52:0/1292325125 >> v1:172.21.15.52:6789/0 conn(0x7f2be40731f0 legacy=0x7f2be4073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be3fff640 1 -- 172.21.15.52:0/1292325125 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be4070c80 con 0x7f2be4073d10 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be37fe640 1 -- 172.21.15.52:0/1292325125 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063159123 0 0) 0x7f2be406f940 con 0x7f2be40731f0 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be3fff640 1 --2- 172.21.15.52:0/1292325125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be4073d10 0x7f2be413b1f0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b372b72c12e73bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.937+0000 7f2be37fe640 1 -- 172.21.15.52:0/1292325125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bd8009d90 con 0x7f2be4073d10 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2be37fe640 1 -- 172.21.15.52:0/1292325125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2bd800e230 con 0x7f2be4073d10 2024-09-11T14:58:36.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2be37fe640 1 -- 172.21.15.52:0/1292325125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bd800e4d0 con 0x7f2be4073d10 2024-09-11T14:58:36.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 -- 172.21.15.52:0/1292325125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be4073d10 msgr2=0x7f2be413b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1292325125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be4073d10 0x7f2be413b1f0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 -- 172.21.15.52:0/1292325125 shutdown_connections 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1292325125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be4073d10 0x7f2be413b1f0 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 -- 172.21.15.52:0/1292325125 >> 172.21.15.52:0/1292325125 conn(0x7f2be40a6c80 msgr2=0x7f2be4071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 -- 172.21.15.52:0/1292325125 shutdown_connections 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.938+0000 7f2beaf91640 1 -- 172.21.15.52:0/1292325125 wait complete. 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.939+0000 7f2beaf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:36.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.940+0000 7f2beaf91640 1 Processor -- start 2024-09-11T14:58:36.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.940+0000 7f2beaf91640 1 -- start start 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2beaf91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 0x7f2be41240d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2beaf91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4123eb0 con 0x7f2be40731f0 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2be8d2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 0x7f2be41240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2be8d2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 0x7f2be41240d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45308/0 (socket says 172.21.15.52:45308) 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2be8d2d640 1 -- 172.21.15.52:0/1981546859 learned_addr learned my addr 172.21.15.52:0/1981546859 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2be8d2d640 1 -- 172.21.15.52:0/1981546859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be4127690 con 0x7f2be40731f0 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.942+0000 7f2be8d2d640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 0x7f2be41240d0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.943+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bd4004b80 con 0x7f2be40731f0 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.943+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2bd4004ce0 con 0x7f2be40731f0 2024-09-11T14:58:36.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.943+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be4125130 con 0x7f2be40731f0 2024-09-11T14:58:36.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.943+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bd4007120 con 0x7f2be40731f0 2024-09-11T14:58:36.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.943+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be4123b10 con 0x7f2be40731f0 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2be40706b0 con 0x7f2be40731f0 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2bd4007320 con 0x7f2be40731f0 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2be17fa640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2bd003e8e0 0x7f2bd0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f2bd404fb00 con 0x7f2be40731f0 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2be17fa640 1 --2- 172.21.15.52:0/1981546859 >> v2:172.21.15.52:6802/4284075780 conn(0x7f2bd0044a20 0x7f2bd0046f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 --> v2:172.21.15.52:6802/4284075780 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bd00475a0 con 0x7f2bd0044a20 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.944+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=731) ==== 24+0+0 (crc 0 0 0) 0x7f2bd404ff10 con 0x7f2be40731f0 2024-09-11T14:58:36.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.945+0000 7f2be3fff640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2bd003e8e0 0x7f2bd0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:36.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.945+0000 7f2be3fff640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2bd003e8e0 0x7f2bd0040df0 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.945+0000 7f2be952e640 1 --2- 172.21.15.52:0/1981546859 >> v2:172.21.15.52:6802/4284075780 conn(0x7f2bd0044a20 0x7f2bd0046f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:58:36.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.949+0000 7f2be952e640 1 --2- 172.21.15.52:0/1981546859 >> v2:172.21.15.52:6802/4284075780 conn(0x7f2bd0044a20 0x7f2bd0046f10 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:36.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.950+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== osd.1 v2:172.21.15.52:6802/4284075780 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f2bd00475a0 con 0x7f2bd0044a20 2024-09-11T14:58:36.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.954+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 --> v2:172.21.15.52:6802/4284075780 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2be4125960 con 0x7f2bd0044a20 2024-09-11T14:58:36.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.955+0000 7f2be17fa640 1 -- 172.21.15.52:0/1981546859 <== osd.1 v2:172.21.15.52:6802/4284075780 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f2be4125960 con 0x7f2bd0044a20 2024-09-11T14:58:36.956 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T14:58:36.957 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "" 2024-09-11T14:58:36.957 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 >> v2:172.21.15.52:6802/4284075780 conn(0x7f2bd0044a20 msgr2=0x7f2bd0046f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1981546859 >> v2:172.21.15.52:6802/4284075780 conn(0x7f2bd0044a20 0x7f2bd0046f10 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2bd003e8e0 msgr2=0x7f2bd0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2bd003e8e0 0x7f2bd0040df0 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 msgr2=0x7f2be41240d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 0x7f2be41240d0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 shutdown_connections 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1981546859 >> v2:172.21.15.52:6802/4284075780 conn(0x7f2bd0044a20 0x7f2bd0046f10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2bd003e8e0 0x7f2bd0040df0 unknown :-1 s=CLOSED pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 --2- 172.21.15.52:0/1981546859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be40731f0 0x7f2be41240d0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 >> 172.21.15.52:0/1981546859 conn(0x7f2be40a6c80 msgr2=0x7f2be411cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 shutdown_connections 2024-09-11T14:58:36.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:36.956+0000 7f2beaf91640 1 -- 172.21.15.52:0/1981546859 wait complete. 2024-09-11T14:58:36.968 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T14:58:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.075+0000 7f6cd6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.082+0000 7f6cd6d91640 1 Processor -- start 2024-09-11T14:58:37.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.082+0000 7f6cd6d91640 1 -- start start 2024-09-11T14:58:37.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.083+0000 7f6cd6d91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cd00a4930 0x7f6cd013b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.083+0000 7f6cd6d91640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd006ec50 con 0x7f6cd00a3e10 2024-09-11T14:58:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.083+0000 7f6cd6d91640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd00a6130 con 0x7f6cd00a4930 2024-09-11T14:58:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.083+0000 7f6cd4b2d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6cd00a3e10 0x7f6cd00a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48880/0 (socket says 172.21.15.52:48880) 2024-09-11T14:58:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.083+0000 7f6ccffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cd00a4930 0x7f6cd013b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6cd4b2d640 1 -- 172.21.15.52:0/3889892653 learned_addr learned my addr 172.21.15.52:0/3889892653 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:37.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccf7fe640 1 -- 172.21.15.52:0/3889892653 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598006445 0 0) 0x7f6cd006ec50 con 0x7f6cd00a3e10 2024-09-11T14:58:37.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccf7fe640 1 -- 172.21.15.52:0/3889892653 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc0003580 con 0x7f6cd00a3e10 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccffff640 1 -- 172.21.15.52:0/3889892653 >> v1:172.21.15.52:6789/0 conn(0x7f6cd00a3e10 legacy=0x7f6cd00a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccffff640 1 -- 172.21.15.52:0/3889892653 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd00a5110 con 0x7f6cd00a4930 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccffff640 1 --2- 172.21.15.52:0/3889892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a4930 0x7f6cd013b2d0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d15fc79688ef02c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccf7fe640 1 -- 172.21.15.52:0/3889892653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6cbc009d90 con 0x7f6cd00a4930 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccf7fe640 1 -- 172.21.15.52:0/3889892653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6cbc00e230 con 0x7f6cd00a4930 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.084+0000 7f6ccf7fe640 1 -- 172.21.15.52:0/3889892653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6cbc00e4d0 con 0x7f6cd00a4930 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 -- 172.21.15.52:0/3889892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a4930 msgr2=0x7f6cd013b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 --2- 172.21.15.52:0/3889892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a4930 0x7f6cd013b2d0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 -- 172.21.15.52:0/3889892653 shutdown_connections 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 --2- 172.21.15.52:0/3889892653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a4930 0x7f6cd013b2d0 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 -- 172.21.15.52:0/3889892653 >> 172.21.15.52:0/3889892653 conn(0x7f6cd00a74f0 msgr2=0x7f6cd00a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 -- 172.21.15.52:0/3889892653 shutdown_connections 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 1 -- 172.21.15.52:0/3889892653 wait complete. 2024-09-11T14:58:37.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.085+0000 7f6cd6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.087+0000 7f6cd6d91640 1 Processor -- start 2024-09-11T14:58:37.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.087+0000 7f6cd6d91640 1 -- start start 2024-09-11T14:58:37.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd6d91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 0x7f6cd0123ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd6d91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0125550 con 0x7f6cd00a3e10 2024-09-11T14:58:37.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd4b2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 0x7f6cd0123ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd4b2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 0x7f6cd0123ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45330/0 (socket says 172.21.15.52:45330) 2024-09-11T14:58:37.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd4b2d640 1 -- 172.21.15.52:0/659049253 learned_addr learned my addr 172.21.15.52:0/659049253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:37.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd4b2d640 1 -- 172.21.15.52:0/659049253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0124d10 con 0x7f6cd00a3e10 2024-09-11T14:58:37.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.089+0000 7f6cd4b2d640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 0x7f6cd0123ad0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.090+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6cc4005a60 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.090+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6cc4005bc0 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.090+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd0125e00 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.090+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6cc4005e60 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.090+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd0126580 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.091+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd01279a0 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.091+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6cc40070b0 con 0x7f6cd00a3e10 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.091+0000 7f6ccd7fa640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6cb403e8e0 0x7f6cb4040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.091+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f6cc404f990 con 0x7f6cd00a3e10 2024-09-11T14:58:37.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.091+0000 7f6ccffff640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6cb403e8e0 0x7f6cb4040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.092+0000 7f6ccffff640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6cb403e8e0 0x7f6cb4040df0 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.096+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6cc400dc60 con 0x7f6cd00a3e10 2024-09-11T14:58:37.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.285+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6cd0073410 con 0x7f6cb403e8e0 2024-09-11T14:58:37.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.285+0000 7f6ccd7fa640 1 -- 172.21.15.52:0/659049253 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f6cd0073410 con 0x7f6cb403e8e0 2024-09-11T14:58:37.287 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T14:58:37.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6cb403e8e0 msgr2=0x7f6cb4040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6cb403e8e0 0x7f6cb4040df0 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 msgr2=0x7f6cd0123ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 0x7f6cd0123ad0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 shutdown_connections 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f6cb403e8e0 0x7f6cb4040df0 unknown :-1 s=CLOSED pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 --2- 172.21.15.52:0/659049253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd00a3e10 0x7f6cd0123ad0 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 >> 172.21.15.52:0/659049253 conn(0x7f6cd00a74f0 msgr2=0x7f6cd0071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 shutdown_connections 2024-09-11T14:58:37.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.288+0000 7f6cd6d91640 1 -- 172.21.15.52:0/659049253 wait complete. 2024-09-11T14:58:37.309 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T14:58:37.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:58:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.425+0000 7f2ce8afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.435+0000 7f2ce8afd640 1 Processor -- start 2024-09-11T14:58:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.435+0000 7f2ce8afd640 1 -- start start 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce8afd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ce40728e0 0x7f2ce4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce8afd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce40a49e0 con 0x7f2ce4073230 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce8afd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce40a4c80 con 0x7f2ce40728e0 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ce40728e0 0x7f2ce4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ce40728e0 0x7f2ce4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45334/0 (socket says 172.21.15.52:45334) 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce259c640 1 -- 172.21.15.52:0/2422836205 learned_addr learned my addr 172.21.15.52:0/2422836205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce1d9b640 1 --1- 172.21.15.52:0/2422836205 >> v1:172.21.15.52:6789/0 conn(0x7f2ce4073230 0x7f2ce4132a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48896/0 (socket says 172.21.15.52:48896) 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce259c640 1 -- 172.21.15.52:0/2422836205 >> v1:172.21.15.52:6789/0 conn(0x7f2ce4073230 legacy=0x7f2ce4132a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce159a640 1 -- 172.21.15.52:0/2422836205 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513730029 0 0) 0x7f2ce40a49e0 con 0x7f2ce4073230 2024-09-11T14:58:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.437+0000 7f2ce259c640 1 -- 172.21.15.52:0/2422836205 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce409c9e0 con 0x7f2ce40728e0 2024-09-11T14:58:37.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.438+0000 7f2ce259c640 1 --2- 172.21.15.52:0/2422836205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4072cf0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd2b14ba3a29d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.438+0000 7f2ce159a640 1 -- 172.21.15.52:0/2422836205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2cd4009e40 con 0x7f2ce40728e0 2024-09-11T14:58:37.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.438+0000 7f2ce159a640 1 -- 172.21.15.52:0/2422836205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2cd400e230 con 0x7f2ce40728e0 2024-09-11T14:58:37.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.438+0000 7f2ce159a640 1 -- 172.21.15.52:0/2422836205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2cd400e4d0 con 0x7f2ce40728e0 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 -- 172.21.15.52:0/2422836205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 msgr2=0x7f2ce4072cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/2422836205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4072cf0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 -- 172.21.15.52:0/2422836205 shutdown_connections 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/2422836205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4072cf0 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 -- 172.21.15.52:0/2422836205 >> 172.21.15.52:0/2422836205 conn(0x7f2ce40a39b0 msgr2=0x7f2ce40a3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 -- 172.21.15.52:0/2422836205 shutdown_connections 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 1 -- 172.21.15.52:0/2422836205 wait complete. 2024-09-11T14:58:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.439+0000 7f2ce8afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.441+0000 7f2ce8afd640 1 Processor -- start 2024-09-11T14:58:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.441+0000 7f2ce8afd640 1 -- start start 2024-09-11T14:58:37.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.442+0000 7f2ce8afd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.442+0000 7f2ce8afd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4120900 con 0x7f2ce40728e0 2024-09-11T14:58:37.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45346/0 (socket says 172.21.15.52:45346) 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce259c640 1 -- 172.21.15.52:0/4232124940 learned_addr learned my addr 172.21.15.52:0/4232124940 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce259c640 1 -- 172.21.15.52:0/4232124940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce4121e60 con 0x7f2ce40728e0 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce259c640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4120d50 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2cd4018040 con 0x7f2ce40728e0 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2cd40115e0 con 0x7f2ce40728e0 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce4120560 con 0x7f2ce40728e0 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2cd4011880 con 0x7f2ce40728e0 2024-09-11T14:58:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.443+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce4123700 con 0x7f2ce40728e0 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.444+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ce409d2c0 con 0x7f2ce40728e0 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.444+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2cd4011a30 con 0x7f2ce40728e0 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.445+0000 7f2cdaffd640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2cc403e930 0x7f2cc4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.445+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f2cd4052500 con 0x7f2ce40728e0 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.445+0000 7f2cdaffd640 1 --2- 172.21.15.52:0/4232124940 >> v2:172.21.15.143:6808/2099775818 conn(0x7f2cc4044a70 0x7f2cc4046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.445+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 --> v2:172.21.15.143:6808/2099775818 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cc40475f0 con 0x7f2cc4044a70 2024-09-11T14:58:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.445+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=731) ==== 24+0+0 (crc 0 0 0) 0x7f2cd40549f0 con 0x7f2ce40728e0 2024-09-11T14:58:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.445+0000 7f2ce1d9b640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2cc403e930 0x7f2cc4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.446+0000 7f2ce1d9b640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2cc403e930 0x7f2cc4040e40 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.446+0000 7f2ce2d9d640 1 --2- 172.21.15.52:0/4232124940 >> v2:172.21.15.143:6808/2099775818 conn(0x7f2cc4044a70 0x7f2cc4046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:58:37.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.450+0000 7f2ce2d9d640 1 --2- 172.21.15.52:0/4232124940 >> v2:172.21.15.143:6808/2099775818 conn(0x7f2cc4044a70 0x7f2cc4046f60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.452+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== osd.2 v2:172.21.15.143:6808/2099775818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f2cc40475f0 con 0x7f2cc4044a70 2024-09-11T14:58:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.456+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 --> v2:172.21.15.143:6808/2099775818 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2ce4122e80 con 0x7f2cc4044a70 2024-09-11T14:58:37.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.457+0000 7f2cdaffd640 1 -- 172.21.15.52:0/4232124940 <== osd.2 v2:172.21.15.143:6808/2099775818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f2ce4122e80 con 0x7f2cc4044a70 2024-09-11T14:58:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T14:58:37.459 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "" 2024-09-11T14:58:37.459 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 >> v2:172.21.15.143:6808/2099775818 conn(0x7f2cc4044a70 msgr2=0x7f2cc4046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/4232124940 >> v2:172.21.15.143:6808/2099775818 conn(0x7f2cc4044a70 0x7f2cc4046f60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2cc403e930 msgr2=0x7f2cc4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2cc403e930 0x7f2cc4040e40 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 msgr2=0x7f2ce4120d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4120d50 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 shutdown_connections 2024-09-11T14:58:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/4232124940 >> v2:172.21.15.143:6808/2099775818 conn(0x7f2cc4044a70 0x7f2cc4046f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f2cc403e930 0x7f2cc4040e40 unknown :-1 s=CLOSED pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 --2- 172.21.15.52:0/4232124940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ce40728e0 0x7f2ce4120d50 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 >> 172.21.15.52:0/4232124940 conn(0x7f2ce40a39b0 msgr2=0x7f2ce41b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 shutdown_connections 2024-09-11T14:58:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.458+0000 7f2ce8afd640 1 -- 172.21.15.52:0/4232124940 wait complete. 2024-09-11T14:58:37.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T14:58:37.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.577+0000 7fdbcfb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.584+0000 7fdbcfb91640 1 Processor -- start 2024-09-11T14:58:37.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.584+0000 7fdbcfb91640 1 -- start start 2024-09-11T14:58:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.585+0000 7fdbcfb91640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbc809d9f0 0x7fdbc8138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.585+0000 7fdbcfb91640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc80745c0 con 0x7fdbc8133b30 2024-09-11T14:58:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.585+0000 7fdbcfb91640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc809e280 con 0x7fdbc809d9f0 2024-09-11T14:58:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.585+0000 7fdbcd12c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbc809d9f0 0x7fdbc8138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcd12c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbc809d9f0 0x7fdbc8138f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45352/0 (socket says 172.21.15.52:45352) 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcd12c640 1 -- 172.21.15.52:0/2694236370 learned_addr learned my addr 172.21.15.52:0/2694236370 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcd92d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdbc8133b30 0x7fdbc8133f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48910/0 (socket says 172.21.15.52:48910) 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcd12c640 1 -- 172.21.15.52:0/2694236370 >> v1:172.21.15.52:6789/0 conn(0x7fdbc8133b30 legacy=0x7fdbc8133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcd12c640 1 -- 172.21.15.52:0/2694236370 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc809df70 con 0x7fdbc809d9f0 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcc92b640 1 -- 172.21.15.52:0/2694236370 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418038232 0 0) 0x7fdbc80745c0 con 0x7fdbc8133b30 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcd12c640 1 --2- 172.21.15.52:0/2694236370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8138f80 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d899540192527b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcc92b640 1 -- 172.21.15.52:0/2694236370 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbb8009e50 con 0x7fdbc809d9f0 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcc92b640 1 -- 172.21.15.52:0/2694236370 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdbb800e230 con 0x7fdbc809d9f0 2024-09-11T14:58:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.586+0000 7fdbcc92b640 1 -- 172.21.15.52:0/2694236370 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbb800e4d0 con 0x7fdbc809d9f0 2024-09-11T14:58:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2694236370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 msgr2=0x7fdbc8138f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 --2- 172.21.15.52:0/2694236370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8138f80 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2694236370 shutdown_connections 2024-09-11T14:58:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 --2- 172.21.15.52:0/2694236370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8138f80 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2694236370 >> 172.21.15.52:0/2694236370 conn(0x7fdbc80a42e0 msgr2=0x7fdbc8073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2694236370 shutdown_connections 2024-09-11T14:58:37.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2694236370 wait complete. 2024-09-11T14:58:37.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.587+0000 7fdbcfb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.589+0000 7fdbcfb91640 1 Processor -- start 2024-09-11T14:58:37.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.589+0000 7fdbcfb91640 1 -- start start 2024-09-11T14:58:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcfb91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8120f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcfb91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8120550 con 0x7fdbc809d9f0 2024-09-11T14:58:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcd92d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8120f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcd92d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8120f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45356/0 (socket says 172.21.15.52:45356) 2024-09-11T14:58:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcd92d640 1 -- 172.21.15.52:0/2864188277 learned_addr learned my addr 172.21.15.52:0/2864188277 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcd92d640 1 -- 172.21.15.52:0/2864188277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc8120ae0 con 0x7fdbc809d9f0 2024-09-11T14:58:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcd92d640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8120f30 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbc40059a0 con 0x7fdbc809d9f0 2024-09-11T14:58:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdbc4005b00 con 0x7fdbc809d9f0 2024-09-11T14:58:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc8122010 con 0x7fdbc809d9f0 2024-09-11T14:58:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbc4005da0 con 0x7fdbc809d9f0 2024-09-11T14:58:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.591+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc8122880 con 0x7fdbc809d9f0 2024-09-11T14:58:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.592+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc80008d0 con 0x7fdbc809d9f0 2024-09-11T14:58:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.593+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdbc40070b0 con 0x7fdbc809d9f0 2024-09-11T14:58:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.593+0000 7fdbbe7fc640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdbac03e930 0x7fdbac040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.593+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7fdbc404f970 con 0x7fdbc809d9f0 2024-09-11T14:58:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.593+0000 7fdbcd12c640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdbac03e930 0x7fdbac040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.594+0000 7fdbcd12c640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdbac03e930 0x7fdbac040e40 crc :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.598+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fdbc400dc10 con 0x7fdbc809d9f0 2024-09-11T14:58:37.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.786+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdbc8134650 con 0x7fdbac03e930 2024-09-11T14:58:37.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.787+0000 7fdbbe7fc640 1 -- 172.21.15.52:0/2864188277 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fdbb800e4a0 con 0x7fdbac03e930 2024-09-11T14:58:37.789 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdbac03e930 msgr2=0x7fdbac040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdbac03e930 0x7fdbac040e40 crc :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 msgr2=0x7fdbc8120f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8120f30 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 shutdown_connections 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fdbac03e930 0x7fdbac040e40 unknown :-1 s=CLOSED pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 --2- 172.21.15.52:0/2864188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbc809d9f0 0x7fdbc8120f30 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 >> 172.21.15.52:0/2864188277 conn(0x7fdbc80a42e0 msgr2=0x7fdbc809fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 shutdown_connections 2024-09-11T14:58:37.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.789+0000 7fdbcfb91640 1 -- 172.21.15.52:0/2864188277 wait complete. 2024-09-11T14:58:37.802 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T14:58:37.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:58:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.928+0000 7fbe83474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.938+0000 7fbe83474640 1 Processor -- start 2024-09-11T14:58:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.939+0000 7fbe83474640 1 -- start start 2024-09-11T14:58:37.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.940+0000 7fbe83474640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe7c0a3e10 0x7fbe7c0a4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.940+0000 7fbe83474640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe7c0a5120 con 0x7fbe7c0a4760 2024-09-11T14:58:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.940+0000 7fbe83474640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbe7c0a5730 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.940+0000 7fbe81210640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe7c0a3e10 0x7fbe7c0a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.940+0000 7fbe80a0f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbe7c0a4760 0x7fbe7c135e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48918/0 (socket says 172.21.15.52:48918) 2024-09-11T14:58:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.940+0000 7fbe80a0f640 1 -- 172.21.15.52:0/2805488674 learned_addr learned my addr 172.21.15.52:0/2805488674 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.941+0000 7fbe81210640 1 -- 172.21.15.52:0/2805488674 >> v1:172.21.15.52:6789/0 conn(0x7fbe7c0a4760 legacy=0x7fbe7c135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.941+0000 7fbe81210640 1 -- 172.21.15.52:0/2805488674 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7c06e770 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.941+0000 7fbe81210640 1 --2- 172.21.15.52:0/2805488674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c0a4220 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d219c959eda7215 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.941+0000 7fbe73fff640 1 -- 172.21.15.52:0/2805488674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe78009d80 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.941+0000 7fbe73fff640 1 -- 172.21.15.52:0/2805488674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbe7800e230 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.941+0000 7fbe73fff640 1 -- 172.21.15.52:0/2805488674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe7800e4d0 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 -- 172.21.15.52:0/2805488674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 msgr2=0x7fbe7c0a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 --2- 172.21.15.52:0/2805488674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c0a4220 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 -- 172.21.15.52:0/2805488674 shutdown_connections 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 --2- 172.21.15.52:0/2805488674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c0a4220 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 -- 172.21.15.52:0/2805488674 >> 172.21.15.52:0/2805488674 conn(0x7fbe7c0a74f0 msgr2=0x7fbe7c0a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 -- 172.21.15.52:0/2805488674 shutdown_connections 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.942+0000 7fbe83474640 1 -- 172.21.15.52:0/2805488674 wait complete. 2024-09-11T14:58:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.943+0000 7fbe83474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:37.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.944+0000 7fbe83474640 1 Processor -- start 2024-09-11T14:58:37.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.944+0000 7fbe83474640 1 -- start start 2024-09-11T14:58:37.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.946+0000 7fbe83474640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c1232b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.946+0000 7fbe83474640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c124e90 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.946+0000 7fbe81210640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c1232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.946+0000 7fbe81210640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c1232b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45378/0 (socket says 172.21.15.52:45378) 2024-09-11T14:58:37.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.946+0000 7fbe81210640 1 -- 172.21.15.52:0/880178922 learned_addr learned my addr 172.21.15.52:0/880178922 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:37.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe81210640 1 -- 172.21.15.52:0/880178922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7c122d60 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe81210640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c1232b0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe78014540 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbe780146a0 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7c124220 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe78014940 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.947+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe7c1229c0 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.948+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe7c1268b0 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.948+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbe78014d50 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe71ffb640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbe6003e8e0 0x7fbe60040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7fbe78019040 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe71ffb640 1 --2- 172.21.15.52:0/880178922 >> v2:172.21.15.143:6803/3147275988 conn(0x7fbe60044a80 0x7fbe60046f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 --> v2:172.21.15.143:6803/3147275988 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe60047600 con 0x7fbe60044a80 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=731) ==== 24+0+0 (crc 0 0 0) 0x7fbe780539d0 con 0x7fbe7c0a3e10 2024-09-11T14:58:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe80a0f640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbe6003e8e0 0x7fbe60040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.949+0000 7fbe80a0f640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbe6003e8e0 0x7fbe60040df0 crc :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.951+0000 7fbe81a11640 1 --2- 172.21.15.52:0/880178922 >> v2:172.21.15.143:6803/3147275988 conn(0x7fbe60044a80 0x7fbe60046f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:58:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.955+0000 7fbe81a11640 1 --2- 172.21.15.52:0/880178922 >> v2:172.21.15.143:6803/3147275988 conn(0x7fbe60044a80 0x7fbe60046f70 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.957+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== osd.3 v2:172.21.15.143:6803/3147275988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fbe60047600 con 0x7fbe60044a80 2024-09-11T14:58:37.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.960+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 --> v2:172.21.15.143:6803/3147275988 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe7c0a5c60 con 0x7fbe60044a80 2024-09-11T14:58:37.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe71ffb640 1 -- 172.21.15.52:0/880178922 <== osd.3 v2:172.21.15.143:6803/3147275988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fbe7400a820 con 0x7fbe60044a80 2024-09-11T14:58:37.964 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T14:58:37.964 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "" 2024-09-11T14:58:37.964 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T14:58:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 >> v2:172.21.15.143:6803/3147275988 conn(0x7fbe60044a80 msgr2=0x7fbe60046f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 --2- 172.21.15.52:0/880178922 >> v2:172.21.15.143:6803/3147275988 conn(0x7fbe60044a80 0x7fbe60046f70 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbe6003e8e0 msgr2=0x7fbe60040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbe6003e8e0 0x7fbe60040df0 crc :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 msgr2=0x7fbe7c1232b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c1232b0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.963+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 shutdown_connections 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.964+0000 7fbe83474640 1 --2- 172.21.15.52:0/880178922 >> v2:172.21.15.143:6803/3147275988 conn(0x7fbe60044a80 0x7fbe60046f70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.964+0000 7fbe83474640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fbe6003e8e0 0x7fbe60040df0 unknown :-1 s=CLOSED pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.964+0000 7fbe83474640 1 --2- 172.21.15.52:0/880178922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe7c0a3e10 0x7fbe7c1232b0 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.964+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 >> 172.21.15.52:0/880178922 conn(0x7fbe7c0a74f0 msgr2=0x7fbe7c1be2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.964+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 shutdown_connections 2024-09-11T14:58:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:37.964+0000 7fbe83474640 1 -- 172.21.15.52:0/880178922 wait complete. 2024-09-11T14:58:37.975 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T14:58:38.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.085+0000 7f1c9e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:38.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.092+0000 7f1c9e391640 1 Processor -- start 2024-09-11T14:58:38.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.092+0000 7f1c9e391640 1 -- start start 2024-09-11T14:58:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.093+0000 7f1c9e391640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c9806f2d0 0x7f1c98138e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.093+0000 7f1c9e391640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c9809f270 con 0x7f1c9806e7b0 2024-09-11T14:58:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.093+0000 7f1c9e391640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9809ef60 con 0x7f1c9806f2d0 2024-09-11T14:58:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.093+0000 7f1c97fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1c9806e7b0 0x7f1c9806ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48924/0 (socket says 172.21.15.52:48924) 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.093+0000 7f1c97fff640 1 -- 172.21.15.52:0/4004114810 learned_addr learned my addr 172.21.15.52:0/4004114810 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.093+0000 7f1c977fe640 1 --2- 172.21.15.52:0/4004114810 >> v2:172.21.15.52:3300/0 conn(0x7f1c9806f2d0 0x7f1c98138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c96ffd640 1 -- 172.21.15.52:0/4004114810 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271305378 0 0) 0x7f1c9809f270 con 0x7f1c9806e7b0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c96ffd640 1 -- 172.21.15.52:0/4004114810 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c80003580 con 0x7f1c9806e7b0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c977fe640 1 -- 172.21.15.52:0/4004114810 >> v1:172.21.15.52:6789/0 conn(0x7f1c9806e7b0 legacy=0x7f1c9806ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c977fe640 1 -- 172.21.15.52:0/4004114810 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9809e840 con 0x7f1c9806f2d0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c977fe640 1 --2- 172.21.15.52:0/4004114810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806f2d0 0x7f1c98138e70 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e585a4fcbc12a40e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c96ffd640 1 -- 172.21.15.52:0/4004114810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c8c009d90 con 0x7f1c9806f2d0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c96ffd640 1 -- 172.21.15.52:0/4004114810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1c8c00e230 con 0x7f1c9806f2d0 2024-09-11T14:58:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.094+0000 7f1c96ffd640 1 -- 172.21.15.52:0/4004114810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c8c00e4d0 con 0x7f1c9806f2d0 2024-09-11T14:58:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 -- 172.21.15.52:0/4004114810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806f2d0 msgr2=0x7f1c98138e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 --2- 172.21.15.52:0/4004114810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806f2d0 0x7f1c98138e70 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 -- 172.21.15.52:0/4004114810 shutdown_connections 2024-09-11T14:58:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 --2- 172.21.15.52:0/4004114810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806f2d0 0x7f1c98138e70 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 -- 172.21.15.52:0/4004114810 >> 172.21.15.52:0/4004114810 conn(0x7f1c980a40f0 msgr2=0x7f1c980a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 -- 172.21.15.52:0/4004114810 shutdown_connections 2024-09-11T14:58:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 1 -- 172.21.15.52:0/4004114810 wait complete. 2024-09-11T14:58:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.095+0000 7f1c9e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.097+0000 7f1c9e391640 1 Processor -- start 2024-09-11T14:58:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.097+0000 7f1c9e391640 1 -- start start 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c9e391640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 0x7f1c98121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c9e391640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98122f80 con 0x7f1c9806e7b0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 0x7f1c98121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 0x7f1c98121500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45384/0 (socket says 172.21.15.52:45384) 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c97fff640 1 -- 172.21.15.52:0/104561819 learned_addr learned my addr 172.21.15.52:0/104561819 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c97fff640 1 -- 172.21.15.52:0/104561819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c98122740 con 0x7f1c9806e7b0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.099+0000 7f1c97fff640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 0x7f1c98121500 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.100+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c88005a60 con 0x7f1c9806e7b0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.100+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1c88005bc0 con 0x7f1c9806e7b0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.100+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c98123830 con 0x7f1c9806e7b0 2024-09-11T14:58:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.100+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c88005e60 con 0x7f1c9806e7b0 2024-09-11T14:58:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.100+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c98123fb0 con 0x7f1c9806e7b0 2024-09-11T14:58:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.101+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c981253d0 con 0x7f1c9806e7b0 2024-09-11T14:58:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.101+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1c880070b0 con 0x7f1c9806e7b0 2024-09-11T14:58:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.101+0000 7f1c94ff9640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1c8403e930 0x7f1c84040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.101+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f1c8804f940 con 0x7f1c9806e7b0 2024-09-11T14:58:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.101+0000 7f1c977fe640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1c8403e930 0x7f1c84040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.102+0000 7f1c977fe640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1c8403e930 0x7f1c84040e40 crc :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:38.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.106+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1c8800dc60 con 0x7f1c9806e7b0 2024-09-11T14:58:38.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.296+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f1c9809e3f0 con 0x7f1c8403e930 2024-09-11T14:58:38.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.296+0000 7f1c94ff9640 1 -- 172.21.15.52:0/104561819 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f1c8c009d60 con 0x7f1c8403e930 2024-09-11T14:58:38.298 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T14:58:38.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1c8403e930 msgr2=0x7f1c84040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1c8403e930 0x7f1c84040e40 crc :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 msgr2=0x7f1c98121500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 0x7f1c98121500 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 shutdown_connections 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1c8403e930 0x7f1c84040e40 unknown :-1 s=CLOSED pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 --2- 172.21.15.52:0/104561819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c9806e7b0 0x7f1c98121500 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 >> 172.21.15.52:0/104561819 conn(0x7f1c980a40f0 msgr2=0x7f1c980a1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 shutdown_connections 2024-09-11T14:58:38.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.299+0000 7f1c9e391640 1 -- 172.21.15.52:0/104561819 wait complete. 2024-09-11T14:58:38.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:58:38.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.422+0000 7f1abb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:38.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.427+0000 7f1abb191640 1 Processor -- start 2024-09-11T14:58:38.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.427+0000 7f1abb191640 1 -- start start 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1abb191640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ab406e7b0 0x7f1ab406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1abb191640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab409f270 con 0x7f1ab406f100 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1abb191640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab409ef60 con 0x7f1ab406e7b0 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1ab8f2d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ab406e7b0 0x7f1ab406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1ab8f2d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ab406e7b0 0x7f1ab406ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45390/0 (socket says 172.21.15.52:45390) 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1ab3fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1ab406f100 0x7f1ab4133a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48930/0 (socket says 172.21.15.52:48930) 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1ab8f2d640 1 -- 172.21.15.52:0/3494067141 learned_addr learned my addr 172.21.15.52:0/3494067141 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1ab8f2d640 1 -- 172.21.15.52:0/3494067141 >> v1:172.21.15.52:6789/0 conn(0x7f1ab406f100 legacy=0x7f1ab4133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.429+0000 7f1ab8f2d640 1 -- 172.21.15.52:0/3494067141 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab409e840 con 0x7f1ab406e7b0 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1ab8f2d640 1 --2- 172.21.15.52:0/3494067141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab406ebc0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7359b8bdc17a5f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1ab37fe640 1 -- 172.21.15.52:0/3494067141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aa4009e50 con 0x7f1ab406e7b0 2024-09-11T14:58:38.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1ab37fe640 1 -- 172.21.15.52:0/3494067141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1aa400e230 con 0x7f1ab406e7b0 2024-09-11T14:58:38.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1ab37fe640 1 -- 172.21.15.52:0/3494067141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aa400e4d0 con 0x7f1ab406e7b0 2024-09-11T14:58:38.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1abb191640 1 -- 172.21.15.52:0/3494067141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 msgr2=0x7f1ab406ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1abb191640 1 --2- 172.21.15.52:0/3494067141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab406ebc0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1abb191640 1 -- 172.21.15.52:0/3494067141 shutdown_connections 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1abb191640 1 --2- 172.21.15.52:0/3494067141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab406ebc0 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.430+0000 7f1abb191640 1 -- 172.21.15.52:0/3494067141 >> 172.21.15.52:0/3494067141 conn(0x7f1ab40a40f0 msgr2=0x7f1ab40a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.431+0000 7f1abb191640 1 -- 172.21.15.52:0/3494067141 shutdown_connections 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.431+0000 7f1abb191640 1 -- 172.21.15.52:0/3494067141 wait complete. 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.431+0000 7f1abb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.433+0000 7f1abb191640 1 Processor -- start 2024-09-11T14:58:38.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.433+0000 7f1abb191640 1 -- start start 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.434+0000 7f1abb191640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab4121df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.434+0000 7f1abb191640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4121410 con 0x7f1ab406e7b0 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.434+0000 7f1ab8f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab4121df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.434+0000 7f1ab8f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab4121df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45406/0 (socket says 172.21.15.52:45406) 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.434+0000 7f1ab8f2d640 1 -- 172.21.15.52:0/3343946306 learned_addr learned my addr 172.21.15.52:0/3343946306 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1ab8f2d640 1 -- 172.21.15.52:0/3343946306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab41219a0 con 0x7f1ab406e7b0 2024-09-11T14:58:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1ab8f2d640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab4121df0 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aa400eda0 con 0x7f1ab406e7b0 2024-09-11T14:58:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1aa4015420 con 0x7f1ab406e7b0 2024-09-11T14:58:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab4123800 con 0x7f1ab406e7b0 2024-09-11T14:58:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aa40156c0 con 0x7f1ab406e7b0 2024-09-11T14:58:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.435+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab4121600 con 0x7f1ab406e7b0 2024-09-11T14:58:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.436+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab406ebc0 con 0x7f1ab406e7b0 2024-09-11T14:58:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.436+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1aa40158c0 con 0x7f1ab406e7b0 2024-09-11T14:58:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.437+0000 7f1ab17fa640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1aa003e910 0x7f1aa0040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.437+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 412..731) ==== 3431+0+0 (crc 0 0 0) 0x7f1aa4051070 con 0x7f1ab406e7b0 2024-09-11T14:58:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.437+0000 7f1ab3fff640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1aa003e910 0x7f1aa0040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.437+0000 7f1ab3fff640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1aa003e910 0x7f1aa0040e20 crc :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:38.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.442+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1aa4014c10 con 0x7f1ab406e7b0 2024-09-11T14:58:38.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.624+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ab409e3f0 con 0x7f1aa003e910 2024-09-11T14:58:38.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.627+0000 7f1ab17fa640 1 -- 172.21.15.52:0/3343946306 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7f1aa80070b0 con 0x7f1aa003e910 2024-09-11T14:58:38.629 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:58:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:58:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1aa003e910 msgr2=0x7f1aa0040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1aa003e910 0x7f1aa0040e20 crc :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 msgr2=0x7f1ab4121df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab4121df0 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 shutdown_connections 2024-09-11T14:58:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f1aa003e910 0x7f1aa0040e20 unknown :-1 s=CLOSED pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 --2- 172.21.15.52:0/3343946306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ab406e7b0 0x7f1ab4121df0 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 >> 172.21.15.52:0/3343946306 conn(0x7f1ab40a40f0 msgr2=0x7f1ab40a1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 shutdown_connections 2024-09-11T14:58:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:38.630+0000 7f1abb191640 1 -- 172.21.15.52:0/3343946306 wait complete. 2024-09-11T14:58:38.642 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1322,"stamp":"2024-09-11T14:58:37.200915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":23872,"kb_used_data":23872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167040,"statfs":{"total":214211493888,"available":214187048960,"internally_reserved":0,"allocated":24444928,"data_stored":24444928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002375"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.323076+0000","last_change":"2024-09-11T14:44:05.660844+0000","last_active":"2024-09-11T14:58:33.323076+0000","last_peered":"2024-09-11T14:58:33.323076+0000","last_clean":"2024-09-11T14:58:33.323076+0000","last_became_active":"2024-09-11T14:44:05.649994+0000","last_became_peered":"2024-09-11T14:44:05.649994+0000","last_unstale":"2024-09-11T14:58:33.323076+0000","last_undegraded":"2024-09-11T14:58:33.323076+0000","last_fullsized":"2024-09-11T14:58:33.323076+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.345816+0000","last_change":"2024-09-11T14:44:05.854279+0000","last_active":"2024-09-11T14:58:33.345816+0000","last_peered":"2024-09-11T14:58:33.345816+0000","last_clean":"2024-09-11T14:58:33.345816+0000","last_became_active":"2024-09-11T14:44:05.824863+0000","last_became_peered":"2024-09-11T14:44:05.824863+0000","last_unstale":"2024-09-11T14:58:33.345816+0000","last_undegraded":"2024-09-11T14:58:33.345816+0000","last_fullsized":"2024-09-11T14:58:33.345816+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.320048+0000","last_change":"2024-09-11T14:44:05.713742+0000","last_active":"2024-09-11T14:58:33.320048+0000","last_peered":"2024-09-11T14:58:33.320048+0000","last_clean":"2024-09-11T14:58:33.320048+0000","last_became_active":"2024-09-11T14:44:05.683981+0000","last_became_peered":"2024-09-11T14:44:05.683981+0000","last_unstale":"2024-09-11T14:58:33.320048+0000","last_undegraded":"2024-09-11T14:58:33.320048+0000","last_fullsized":"2024-09-11T14:58:33.320048+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.301660+0000","last_change":"2024-09-11T14:44:05.723245+0000","last_active":"2024-09-11T14:58:33.301660+0000","last_peered":"2024-09-11T14:58:33.301660+0000","last_clean":"2024-09-11T14:58:33.301660+0000","last_became_active":"2024-09-11T14:44:05.701327+0000","last_became_peered":"2024-09-11T14:44:05.701327+0000","last_unstale":"2024-09-11T14:58:33.301660+0000","last_undegraded":"2024-09-11T14:58:33.301660+0000","last_fullsized":"2024-09-11T14:58:33.301660+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.352188+0000","last_change":"2024-09-11T14:44:05.751677+0000","last_active":"2024-09-11T14:58:33.352188+0000","last_peered":"2024-09-11T14:58:33.352188+0000","last_clean":"2024-09-11T14:58:33.352188+0000","last_became_active":"2024-09-11T14:44:05.705638+0000","last_became_peered":"2024-09-11T14:44:05.705638+0000","last_unstale":"2024-09-11T14:58:33.352188+0000","last_undegraded":"2024-09-11T14:58:33.352188+0000","last_fullsized":"2024-09-11T14:58:33.352188+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.301122+0000","last_change":"2024-09-11T14:44:05.767557+0000","last_active":"2024-09-11T14:58:33.301122+0000","last_peered":"2024-09-11T14:58:33.301122+0000","last_clean":"2024-09-11T14:58:33.301122+0000","last_became_active":"2024-09-11T14:44:05.670460+0000","last_became_peered":"2024-09-11T14:44:05.670460+0000","last_unstale":"2024-09-11T14:58:33.301122+0000","last_undegraded":"2024-09-11T14:58:33.301122+0000","last_fullsized":"2024-09-11T14:58:33.301122+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.319910+0000","last_change":"2024-09-11T14:44:05.777597+0000","last_active":"2024-09-11T14:58:33.319910+0000","last_peered":"2024-09-11T14:58:33.319910+0000","last_clean":"2024-09-11T14:58:33.319910+0000","last_became_active":"2024-09-11T14:44:05.740371+0000","last_became_peered":"2024-09-11T14:44:05.740371+0000","last_unstale":"2024-09-11T14:58:33.319910+0000","last_undegraded":"2024-09-11T14:58:33.319910+0000","last_fullsized":"2024-09-11T14:58:33.319910+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.346602+0000","last_change":"2024-09-11T14:44:05.810163+0000","last_active":"2024-09-11T14:58:33.346602+0000","last_peered":"2024-09-11T14:58:33.346602+0000","last_clean":"2024-09-11T14:58:33.346602+0000","last_became_active":"2024-09-11T14:44:05.760501+0000","last_became_peered":"2024-09-11T14:44:05.760501+0000","last_unstale":"2024-09-11T14:58:33.346602+0000","last_undegraded":"2024-09-11T14:58:33.346602+0000","last_fullsized":"2024-09-11T14:58:33.346602+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.304625+0000","last_change":"2024-09-11T14:44:05.731506+0000","last_active":"2024-09-11T14:58:33.304625+0000","last_peered":"2024-09-11T14:58:33.304625+0000","last_clean":"2024-09-11T14:58:33.304625+0000","last_became_active":"2024-09-11T14:44:05.710518+0000","last_became_peered":"2024-09-11T14:44:05.710518+0000","last_unstale":"2024-09-11T14:58:33.304625+0000","last_undegraded":"2024-09-11T14:58:33.304625+0000","last_fullsized":"2024-09-11T14:58:33.304625+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.317754+0000","last_change":"2024-09-11T14:44:05.732559+0000","last_active":"2024-09-11T14:58:33.317754+0000","last_peered":"2024-09-11T14:58:33.317754+0000","last_clean":"2024-09-11T14:58:33.317754+0000","last_became_active":"2024-09-11T14:44:05.716117+0000","last_became_peered":"2024-09-11T14:44:05.716117+0000","last_unstale":"2024-09-11T14:58:33.317754+0000","last_undegraded":"2024-09-11T14:58:33.317754+0000","last_fullsized":"2024-09-11T14:58:33.317754+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.314927+0000","last_change":"2024-09-11T14:44:05.819861+0000","last_active":"2024-09-11T14:58:33.314927+0000","last_peered":"2024-09-11T14:58:33.314927+0000","last_clean":"2024-09-11T14:58:33.314927+0000","last_became_active":"2024-09-11T14:44:05.809065+0000","last_became_peered":"2024-09-11T14:44:05.809065+0000","last_unstale":"2024-09-11T14:58:33.314927+0000","last_undegraded":"2024-09-11T14:58:33.314927+0000","last_fullsized":"2024-09-11T14:58:33.314927+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.319414+0000","last_change":"2024-09-11T14:44:05.878169+0000","last_active":"2024-09-11T14:58:33.319414+0000","last_peered":"2024-09-11T14:58:33.319414+0000","last_clean":"2024-09-11T14:58:33.319414+0000","last_became_active":"2024-09-11T14:44:05.807629+0000","last_became_peered":"2024-09-11T14:44:05.807629+0000","last_unstale":"2024-09-11T14:58:33.319414+0000","last_undegraded":"2024-09-11T14:58:33.319414+0000","last_fullsized":"2024-09-11T14:58:33.319414+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.299722+0000","last_change":"2024-09-11T14:44:05.932032+0000","last_active":"2024-09-11T14:58:33.299722+0000","last_peered":"2024-09-11T14:58:33.299722+0000","last_clean":"2024-09-11T14:58:33.299722+0000","last_became_active":"2024-09-11T14:44:05.923287+0000","last_became_peered":"2024-09-11T14:44:05.923287+0000","last_unstale":"2024-09-11T14:58:33.299722+0000","last_undegraded":"2024-09-11T14:58:33.299722+0000","last_fullsized":"2024-09-11T14:58:33.299722+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.308328+0000","last_change":"2024-09-11T14:44:05.811005+0000","last_active":"2024-09-11T14:58:33.308328+0000","last_peered":"2024-09-11T14:58:33.308328+0000","last_clean":"2024-09-11T14:58:33.308328+0000","last_became_active":"2024-09-11T14:44:05.802531+0000","last_became_peered":"2024-09-11T14:44:05.802531+0000","last_unstale":"2024-09-11T14:58:33.308328+0000","last_undegraded":"2024-09-11T14:58:33.308328+0000","last_fullsized":"2024-09-11T14:58:33.308328+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.325151+0000","last_change":"2024-09-11T14:44:05.875259+0000","last_active":"2024-09-11T14:58:33.325151+0000","last_peered":"2024-09-11T14:58:33.325151+0000","last_clean":"2024-09-11T14:58:33.325151+0000","last_became_active":"2024-09-11T14:44:05.865190+0000","last_became_peered":"2024-09-11T14:44:05.865190+0000","last_unstale":"2024-09-11T14:58:33.325151+0000","last_undegraded":"2024-09-11T14:58:33.325151+0000","last_fullsized":"2024-09-11T14:58:33.325151+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.331985+0000","last_change":"2024-09-11T14:44:05.839001+0000","last_active":"2024-09-11T14:58:33.331985+0000","last_peered":"2024-09-11T14:58:33.331985+0000","last_clean":"2024-09-11T14:58:33.331985+0000","last_became_active":"2024-09-11T14:44:05.784807+0000","last_became_peered":"2024-09-11T14:44:05.784807+0000","last_unstale":"2024-09-11T14:58:33.331985+0000","last_undegraded":"2024-09-11T14:58:33.331985+0000","last_fullsized":"2024-09-11T14:58:33.331985+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.341880+0000","last_change":"2024-09-11T14:44:05.818455+0000","last_active":"2024-09-11T14:58:33.341880+0000","last_peered":"2024-09-11T14:58:33.341880+0000","last_clean":"2024-09-11T14:58:33.341880+0000","last_became_active":"2024-09-11T14:44:05.775468+0000","last_became_peered":"2024-09-11T14:44:05.775468+0000","last_unstale":"2024-09-11T14:58:33.341880+0000","last_undegraded":"2024-09-11T14:58:33.341880+0000","last_fullsized":"2024-09-11T14:58:33.341880+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.318808+0000","last_change":"2024-09-11T14:44:05.755511+0000","last_active":"2024-09-11T14:58:33.318808+0000","last_peered":"2024-09-11T14:58:33.318808+0000","last_clean":"2024-09-11T14:58:33.318808+0000","last_became_active":"2024-09-11T14:44:05.723386+0000","last_became_peered":"2024-09-11T14:44:05.723386+0000","last_unstale":"2024-09-11T14:58:33.318808+0000","last_undegraded":"2024-09-11T14:58:33.318808+0000","last_fullsized":"2024-09-11T14:58:33.318808+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.311429+0000","last_change":"2024-09-11T14:44:05.718878+0000","last_active":"2024-09-11T14:58:33.311429+0000","last_peered":"2024-09-11T14:58:33.311429+0000","last_clean":"2024-09-11T14:58:33.311429+0000","last_became_active":"2024-09-11T14:44:05.669284+0000","last_became_peered":"2024-09-11T14:44:05.669284+0000","last_unstale":"2024-09-11T14:58:33.311429+0000","last_undegraded":"2024-09-11T14:58:33.311429+0000","last_fullsized":"2024-09-11T14:58:33.311429+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.340806+0000","last_change":"2024-09-11T14:44:05.731456+0000","last_active":"2024-09-11T14:58:33.340806+0000","last_peered":"2024-09-11T14:58:33.340806+0000","last_clean":"2024-09-11T14:58:33.340806+0000","last_became_active":"2024-09-11T14:44:05.720000+0000","last_became_peered":"2024-09-11T14:44:05.720000+0000","last_unstale":"2024-09-11T14:58:33.340806+0000","last_undegraded":"2024-09-11T14:58:33.340806+0000","last_fullsized":"2024-09-11T14:58:33.340806+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.323923+0000","last_change":"2024-09-11T14:44:06.003807+0000","last_active":"2024-09-11T14:58:33.323923+0000","last_peered":"2024-09-11T14:58:33.323923+0000","last_clean":"2024-09-11T14:58:33.323923+0000","last_became_active":"2024-09-11T14:44:05.994115+0000","last_became_peered":"2024-09-11T14:44:05.994115+0000","last_unstale":"2024-09-11T14:58:33.323923+0000","last_undegraded":"2024-09-11T14:58:33.323923+0000","last_fullsized":"2024-09-11T14:58:33.323923+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.350433+0000","last_change":"2024-09-11T14:44:05.762950+0000","last_active":"2024-09-11T14:58:33.350433+0000","last_peered":"2024-09-11T14:58:33.350433+0000","last_clean":"2024-09-11T14:58:33.350433+0000","last_became_active":"2024-09-11T14:44:05.719555+0000","last_became_peered":"2024-09-11T14:44:05.719555+0000","last_unstale":"2024-09-11T14:58:33.350433+0000","last_undegraded":"2024-09-11T14:58:33.350433+0000","last_fullsized":"2024-09-11T14:58:33.350433+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.336553+0000","last_change":"2024-09-11T14:44:05.669658+0000","last_active":"2024-09-11T14:58:33.336553+0000","last_peered":"2024-09-11T14:58:33.336553+0000","last_clean":"2024-09-11T14:58:33.336553+0000","last_became_active":"2024-09-11T14:44:05.643040+0000","last_became_peered":"2024-09-11T14:44:05.643040+0000","last_unstale":"2024-09-11T14:58:33.336553+0000","last_undegraded":"2024-09-11T14:58:33.336553+0000","last_fullsized":"2024-09-11T14:58:33.336553+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.308490+0000","last_change":"2024-09-11T14:44:05.837046+0000","last_active":"2024-09-11T14:58:33.308490+0000","last_peered":"2024-09-11T14:58:33.308490+0000","last_clean":"2024-09-11T14:58:33.308490+0000","last_became_active":"2024-09-11T14:44:05.827738+0000","last_became_peered":"2024-09-11T14:44:05.827738+0000","last_unstale":"2024-09-11T14:58:33.308490+0000","last_undegraded":"2024-09-11T14:58:33.308490+0000","last_fullsized":"2024-09-11T14:58:33.308490+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.302106+0000","last_change":"2024-09-11T14:44:05.644371+0000","last_active":"2024-09-11T14:58:33.302106+0000","last_peered":"2024-09-11T14:58:33.302106+0000","last_clean":"2024-09-11T14:58:33.302106+0000","last_became_active":"2024-09-11T14:44:05.636002+0000","last_became_peered":"2024-09-11T14:44:05.636002+0000","last_unstale":"2024-09-11T14:58:33.302106+0000","last_undegraded":"2024-09-11T14:58:33.302106+0000","last_fullsized":"2024-09-11T14:58:33.302106+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.323936+0000","last_change":"2024-09-11T14:44:05.784078+0000","last_active":"2024-09-11T14:58:33.323936+0000","last_peered":"2024-09-11T14:58:33.323936+0000","last_clean":"2024-09-11T14:58:33.323936+0000","last_became_active":"2024-09-11T14:44:05.735069+0000","last_became_peered":"2024-09-11T14:44:05.735069+0000","last_unstale":"2024-09-11T14:58:33.323936+0000","last_undegraded":"2024-09-11T14:58:33.323936+0000","last_fullsized":"2024-09-11T14:58:33.323936+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.320373+0000","last_change":"2024-09-11T14:44:05.783552+0000","last_active":"2024-09-11T14:58:33.320373+0000","last_peered":"2024-09-11T14:58:33.320373+0000","last_clean":"2024-09-11T14:58:33.320373+0000","last_became_active":"2024-09-11T14:44:05.746996+0000","last_became_peered":"2024-09-11T14:44:05.746996+0000","last_unstale":"2024-09-11T14:58:33.320373+0000","last_undegraded":"2024-09-11T14:58:33.320373+0000","last_fullsized":"2024-09-11T14:58:33.320373+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.307385+0000","last_change":"2024-09-11T14:44:05.754862+0000","last_active":"2024-09-11T14:58:33.307385+0000","last_peered":"2024-09-11T14:58:33.307385+0000","last_clean":"2024-09-11T14:58:33.307385+0000","last_became_active":"2024-09-11T14:44:05.698451+0000","last_became_peered":"2024-09-11T14:44:05.698451+0000","last_unstale":"2024-09-11T14:58:33.307385+0000","last_undegraded":"2024-09-11T14:58:33.307385+0000","last_fullsized":"2024-09-11T14:58:33.307385+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.339941+0000","last_change":"2024-09-11T14:44:05.767263+0000","last_active":"2024-09-11T14:58:33.339941+0000","last_peered":"2024-09-11T14:58:33.339941+0000","last_clean":"2024-09-11T14:58:33.339941+0000","last_became_active":"2024-09-11T14:44:05.745807+0000","last_became_peered":"2024-09-11T14:44:05.745807+0000","last_unstale":"2024-09-11T14:58:33.339941+0000","last_undegraded":"2024-09-11T14:58:33.339941+0000","last_fullsized":"2024-09-11T14:58:33.339941+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.311377+0000","last_change":"2024-09-11T14:44:05.892263+0000","last_active":"2024-09-11T14:58:33.311377+0000","last_peered":"2024-09-11T14:58:33.311377+0000","last_clean":"2024-09-11T14:58:33.311377+0000","last_became_active":"2024-09-11T14:44:05.775888+0000","last_became_peered":"2024-09-11T14:44:05.775888+0000","last_unstale":"2024-09-11T14:58:33.311377+0000","last_undegraded":"2024-09-11T14:58:33.311377+0000","last_fullsized":"2024-09-11T14:58:33.311377+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1491,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.353620+0000","last_change":"2024-09-11T14:44:05.711979+0000","last_active":"2024-09-11T14:58:33.353620+0000","last_peered":"2024-09-11T14:58:33.353620+0000","last_clean":"2024-09-11T14:58:33.353620+0000","last_became_active":"2024-09-11T14:44:05.661592+0000","last_became_peered":"2024-09-11T14:44:05.661592+0000","last_unstale":"2024-09-11T14:58:33.353620+0000","last_undegraded":"2024-09-11T14:58:33.353620+0000","last_fullsized":"2024-09-11T14:58:33.353620+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1478,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.337437+0000","last_change":"2024-09-11T14:44:05.737957+0000","last_active":"2024-09-11T14:58:33.337437+0000","last_peered":"2024-09-11T14:58:33.337437+0000","last_clean":"2024-09-11T14:58:33.337437+0000","last_became_active":"2024-09-11T14:44:05.719933+0000","last_became_peered":"2024-09-11T14:44:05.719933+0000","last_unstale":"2024-09-11T14:58:33.337437+0000","last_undegraded":"2024-09-11T14:58:33.337437+0000","last_fullsized":"2024-09-11T14:58:33.337437+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:44:04.501737+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.344716+0000","last_change":"2024-09-11T14:38:50.697395+0000","last_active":"2024-09-11T14:58:33.344716+0000","last_peered":"2024-09-11T14:58:33.344716+0000","last_clean":"2024-09-11T14:58:33.344716+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:58:33.344716+0000","last_undegraded":"2024-09-11T14:58:33.344716+0000","last_fullsized":"2024-09-11T14:58:33.344716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.319339+0000","last_change":"2024-09-11T14:38:50.696703+0000","last_active":"2024-09-11T14:58:33.319339+0000","last_peered":"2024-09-11T14:58:33.319339+0000","last_clean":"2024-09-11T14:58:33.319339+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:58:33.319339+0000","last_undegraded":"2024-09-11T14:58:33.319339+0000","last_fullsized":"2024-09-11T14:58:33.319339+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.317804+0000","last_change":"2024-09-11T14:38:50.692528+0000","last_active":"2024-09-11T14:58:33.317804+0000","last_peered":"2024-09-11T14:58:33.317804+0000","last_clean":"2024-09-11T14:58:33.317804+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:58:33.317804+0000","last_undegraded":"2024-09-11T14:58:33.317804+0000","last_fullsized":"2024-09-11T14:58:33.317804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.315131+0000","last_change":"2024-09-11T14:38:50.691975+0000","last_active":"2024-09-11T14:58:33.315131+0000","last_peered":"2024-09-11T14:58:33.315131+0000","last_clean":"2024-09-11T14:58:33.315131+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:58:33.315131+0000","last_undegraded":"2024-09-11T14:58:33.315131+0000","last_fullsized":"2024-09-11T14:58:33.315131+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.329756+0000","last_change":"2024-09-11T14:38:50.693043+0000","last_active":"2024-09-11T14:58:33.329756+0000","last_peered":"2024-09-11T14:58:33.329756+0000","last_clean":"2024-09-11T14:58:33.329756+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:58:33.329756+0000","last_undegraded":"2024-09-11T14:58:33.329756+0000","last_fullsized":"2024-09-11T14:58:33.329756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.325026+0000","last_change":"2024-09-11T14:38:50.691571+0000","last_active":"2024-09-11T14:58:33.325026+0000","last_peered":"2024-09-11T14:58:33.325026+0000","last_clean":"2024-09-11T14:58:33.325026+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:58:33.325026+0000","last_undegraded":"2024-09-11T14:58:33.325026+0000","last_fullsized":"2024-09-11T14:58:33.325026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2161,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.344381+0000","last_change":"2024-09-11T14:38:50.693770+0000","last_active":"2024-09-11T14:58:33.344381+0000","last_peered":"2024-09-11T14:58:33.344381+0000","last_clean":"2024-09-11T14:58:33.344381+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:58:33.344381+0000","last_undegraded":"2024-09-11T14:58:33.344381+0000","last_fullsized":"2024-09-11T14:58:33.344381+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2164,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.346372+0000","last_change":"2024-09-11T14:38:50.697078+0000","last_active":"2024-09-11T14:58:33.346372+0000","last_peered":"2024-09-11T14:58:33.346372+0000","last_clean":"2024-09-11T14:58:33.346372+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:58:33.346372+0000","last_undegraded":"2024-09-11T14:58:33.346372+0000","last_fullsized":"2024-09-11T14:58:33.346372+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:47.563225+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2235,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:33.305856+0000","last_change":"2024-09-11T14:38:46.649079+0000","last_active":"2024-09-11T14:58:33.305856+0000","last_peered":"2024-09-11T14:58:33.305856+0000","last_clean":"2024-09-11T14:58:33.305856+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:58:33.305856+0000","last_undegraded":"2024-09-11T14:58:33.305856+0000","last_fullsized":"2024-09-11T14:58:33.305856+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:38:45.555142+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187986944,"internally_reserved":0,"allocated":23506944,"data_stored":23506944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187986944,"internally_reserved":0,"allocated":23506944,"data_stored":23506944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6080,"kb_used_data":6080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291648,"statfs":{"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5216,"kb_used_data":5216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292512,"statfs":{"total":53552873472,"available":53547532288,"internally_reserved":0,"allocated":5341184,"data_stored":5341184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5188,"kb_used_data":5188,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292540,"statfs":{"total":53552873472,"available":53547560960,"internally_reserved":0,"allocated":5312512,"data_stored":5312512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7388,"kb_used_data":7388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290340,"statfs":{"total":53552873472,"available":53545308160,"internally_reserved":0,"allocated":7565312,"data_stored":7565312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53546246144,"internally_reserved":0,"allocated":6627328,"data_stored":6627328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547560960,"internally_reserved":0,"allocated":5312512,"data_stored":5312512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547532288,"internally_reserved":0,"allocated":5341184,"data_stored":5341184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53546246144,"internally_reserved":0,"allocated":6627328,"data_stored":6627328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547560960,"internally_reserved":0,"allocated":5312512,"data_stored":5312512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547532288,"internally_reserved":0,"allocated":5341184,"data_stored":5341184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:58:38.647 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.647 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.647 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.647 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.647 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.648 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.649 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.650 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-11T14:44:04.501737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=44, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.651 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:38:47.563225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=47, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.652 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:38:45.555142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=38, tm_sec=45, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=58, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:58:38.652 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:58:58.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:58:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.776+0000 7fe73ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.783+0000 7fe73ef51640 1 Processor -- start 2024-09-11T14:58:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.783+0000 7fe73ef51640 1 -- start start 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe73ef51640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe738073d80 0x7fe738139080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe73ef51640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73809e160 con 0x7fe738073260 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe73ef51640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe73809cb00 con 0x7fe738073d80 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe737fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe738073d80 0x7fe738139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe737fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe738073d80 0x7fe738139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44062/0 (socket says 172.21.15.52:44062) 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe73cced640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe738073260 0x7fe738073670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58218/0 (socket says 172.21.15.52:58218) 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.784+0000 7fe737fff640 1 -- 172.21.15.52:0/2960166929 learned_addr learned my addr 172.21.15.52:0/2960166929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe737fff640 1 -- 172.21.15.52:0/2960166929 >> v1:172.21.15.52:6789/0 conn(0x7fe738073260 legacy=0x7fe738073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe7377fe640 1 -- 172.21.15.52:0/2960166929 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128531928 0 0) 0x7fe73809e160 con 0x7fe738073260 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe737fff640 1 -- 172.21.15.52:0/2960166929 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73809d880 con 0x7fe738073d80 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe737fff640 1 --2- 172.21.15.52:0/2960166929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073d80 0x7fe738139080 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449d3cd84b976b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe7377fe640 1 -- 172.21.15.52:0/2960166929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe72c009e50 con 0x7fe738073d80 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe7377fe640 1 -- 172.21.15.52:0/2960166929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe72c00e230 con 0x7fe738073d80 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.785+0000 7fe7377fe640 1 -- 172.21.15.52:0/2960166929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe72c00e4d0 con 0x7fe738073d80 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 -- 172.21.15.52:0/2960166929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073d80 msgr2=0x7fe738139080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 --2- 172.21.15.52:0/2960166929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073d80 0x7fe738139080 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 -- 172.21.15.52:0/2960166929 shutdown_connections 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 --2- 172.21.15.52:0/2960166929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073d80 0x7fe738139080 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 -- 172.21.15.52:0/2960166929 >> 172.21.15.52:0/2960166929 conn(0x7fe7380a6c90 msgr2=0x7fe738071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 -- 172.21.15.52:0/2960166929 shutdown_connections 2024-09-11T14:58:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 1 -- 172.21.15.52:0/2960166929 wait complete. 2024-09-11T14:58:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.786+0000 7fe73ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.788+0000 7fe73ef51640 1 Processor -- start 2024-09-11T14:58:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.788+0000 7fe73ef51640 1 -- start start 2024-09-11T14:58:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73ef51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 0x7fe738121a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73ef51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe738134b20 con 0x7fe738073260 2024-09-11T14:58:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73cced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 0x7fe738121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73cced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 0x7fe738121a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44074/0 (socket says 172.21.15.52:44074) 2024-09-11T14:58:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73cced640 1 -- 172.21.15.52:0/3445627023 learned_addr learned my addr 172.21.15.52:0/3445627023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73cced640 1 -- 172.21.15.52:0/3445627023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe738125210 con 0x7fe738073260 2024-09-11T14:58:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73cced640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 0x7fe738121a00 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe728004b80 con 0x7fe738073260 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe728004ce0 con 0x7fe738073260 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe738123440 con 0x7fe738073260 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.790+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe728007120 con 0x7fe738073260 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.791+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe738123cf0 con 0x7fe738073260 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.792+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe738073670 con 0x7fe738073260 2024-09-11T14:58:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.792+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe7280072d0 con 0x7fe738073260 2024-09-11T14:58:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.792+0000 7fe7357fa640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fe72403e930 0x7fe724040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.792+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 681..731) ==== 3431+0+0 (crc 0 0 0) 0x7fe72804fac0 con 0x7fe738073260 2024-09-11T14:58:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.792+0000 7fe737fff640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fe72403e930 0x7fe724040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.793+0000 7fe737fff640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fe72403e930 0x7fe724040e40 crc :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.797+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe72800f230 con 0x7fe738073260 2024-09-11T14:58:58.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.980+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 --> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe73809de50 con 0x7fe72403e930 2024-09-11T14:58:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.983+0000 7fe7357fa640 1 -- 172.21.15.52:0/3445627023 <== mgr.4100 v2:172.21.15.143:6800/310319615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109422 (crc 0 0 0) 0x7fe72c009e70 con 0x7fe72403e930 2024-09-11T14:58:58.985 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-11T14:58:58.986 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-11T14:58:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fe72403e930 msgr2=0x7fe724040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fe72403e930 0x7fe724040e40 crc :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:58.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 msgr2=0x7fe738121a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 0x7fe738121a00 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 shutdown_connections 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7fe72403e930 0x7fe724040e40 unknown :-1 s=CLOSED pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 --2- 172.21.15.52:0/3445627023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe738073260 0x7fe738121a00 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 >> 172.21.15.52:0/3445627023 conn(0x7fe7380a6c90 msgr2=0x7fe7380a0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 shutdown_connections 2024-09-11T14:58:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:58.985+0000 7fe73ef51640 1 -- 172.21.15.52:0/3445627023 wait complete. 2024-09-11T14:58:58.998 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1332,"stamp":"2024-09-11T14:58:57.206519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":22956,"kb_used_data":22956,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167956,"statfs":{"total":214211493888,"available":214187986944,"internally_reserved":0,"allocated":23506944,"data_stored":23506944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003351"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.297689+0000","last_change":"2024-09-11T14:58:37.335364+0000","last_active":"2024-09-11T14:58:37.297689+0000","last_peered":"2024-09-11T14:58:37.297689+0000","last_clean":"2024-09-11T14:58:37.297689+0000","last_became_active":"2024-09-11T14:44:05.649994+0000","last_became_peered":"2024-09-11T14:44:05.649994+0000","last_unstale":"2024-09-11T14:58:37.297689+0000","last_undegraded":"2024-09-11T14:58:37.297689+0000","last_fullsized":"2024-09-11T14:58:37.297689+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.335168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.335168+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.804069+0000","last_change":"2024-09-11T14:58:36.858618+0000","last_active":"2024-09-11T14:58:36.804069+0000","last_peered":"2024-09-11T14:58:36.804069+0000","last_clean":"2024-09-11T14:58:36.804069+0000","last_became_active":"2024-09-11T14:44:05.824863+0000","last_became_peered":"2024-09-11T14:44:05.824863+0000","last_unstale":"2024-09-11T14:58:36.804069+0000","last_undegraded":"2024-09-11T14:58:36.804069+0000","last_fullsized":"2024-09-11T14:58:36.804069+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.858443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.858443+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.800129+0000","last_change":"2024-09-11T14:58:37.840047+0000","last_active":"2024-09-11T14:58:37.800129+0000","last_peered":"2024-09-11T14:58:37.800129+0000","last_clean":"2024-09-11T14:58:37.800129+0000","last_became_active":"2024-09-11T14:44:05.683981+0000","last_became_peered":"2024-09-11T14:44:05.683981+0000","last_unstale":"2024-09-11T14:58:37.800129+0000","last_undegraded":"2024-09-11T14:58:37.800129+0000","last_fullsized":"2024-09-11T14:58:37.800129+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.839864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.839864+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.310451+0000","last_change":"2024-09-11T14:58:38.374885+0000","last_active":"2024-09-11T14:58:38.310451+0000","last_peered":"2024-09-11T14:58:38.310451+0000","last_clean":"2024-09-11T14:58:38.310451+0000","last_became_active":"2024-09-11T14:44:05.701327+0000","last_became_peered":"2024-09-11T14:44:05.701327+0000","last_unstale":"2024-09-11T14:58:38.310451+0000","last_undegraded":"2024-09-11T14:58:38.310451+0000","last_fullsized":"2024-09-11T14:58:38.310451+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.374700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.374700+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.300277+0000","last_change":"2024-09-11T14:58:37.341677+0000","last_active":"2024-09-11T14:58:37.300277+0000","last_peered":"2024-09-11T14:58:37.300277+0000","last_clean":"2024-09-11T14:58:37.300277+0000","last_became_active":"2024-09-11T14:44:05.705638+0000","last_became_peered":"2024-09-11T14:44:05.705638+0000","last_unstale":"2024-09-11T14:58:37.300277+0000","last_undegraded":"2024-09-11T14:58:37.300277+0000","last_fullsized":"2024-09-11T14:58:37.300277+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.341472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.341472+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.797701+0000","last_change":"2024-09-11T14:58:36.861363+0000","last_active":"2024-09-11T14:58:36.797701+0000","last_peered":"2024-09-11T14:58:36.797701+0000","last_clean":"2024-09-11T14:58:36.797701+0000","last_became_active":"2024-09-11T14:44:05.670460+0000","last_became_peered":"2024-09-11T14:44:05.670460+0000","last_unstale":"2024-09-11T14:58:36.797701+0000","last_undegraded":"2024-09-11T14:58:36.797701+0000","last_fullsized":"2024-09-11T14:58:36.797701+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.861191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.861191+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.799322+0000","last_change":"2024-09-11T14:58:36.834035+0000","last_active":"2024-09-11T14:58:36.799322+0000","last_peered":"2024-09-11T14:58:36.799322+0000","last_clean":"2024-09-11T14:58:36.799322+0000","last_became_active":"2024-09-11T14:44:05.740371+0000","last_became_peered":"2024-09-11T14:44:05.740371+0000","last_unstale":"2024-09-11T14:58:36.799322+0000","last_undegraded":"2024-09-11T14:58:36.799322+0000","last_fullsized":"2024-09-11T14:58:36.799322+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.833803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.833803+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.801576+0000","last_change":"2024-09-11T14:58:36.857178+0000","last_active":"2024-09-11T14:58:36.801576+0000","last_peered":"2024-09-11T14:58:36.801576+0000","last_clean":"2024-09-11T14:58:36.801576+0000","last_became_active":"2024-09-11T14:44:05.760501+0000","last_became_peered":"2024-09-11T14:44:05.760501+0000","last_unstale":"2024-09-11T14:58:36.801576+0000","last_undegraded":"2024-09-11T14:58:36.801576+0000","last_fullsized":"2024-09-11T14:58:36.801576+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.857006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.857006+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.309410+0000","last_change":"2024-09-11T14:58:38.371504+0000","last_active":"2024-09-11T14:58:38.309410+0000","last_peered":"2024-09-11T14:58:38.309410+0000","last_clean":"2024-09-11T14:58:38.309410+0000","last_became_active":"2024-09-11T14:44:05.710518+0000","last_became_peered":"2024-09-11T14:44:05.710518+0000","last_unstale":"2024-09-11T14:58:38.309410+0000","last_undegraded":"2024-09-11T14:58:38.309410+0000","last_fullsized":"2024-09-11T14:58:38.309410+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.371339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.371339+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.797045+0000","last_change":"2024-09-11T14:58:37.826825+0000","last_active":"2024-09-11T14:58:37.797045+0000","last_peered":"2024-09-11T14:58:37.797045+0000","last_clean":"2024-09-11T14:58:37.797045+0000","last_became_active":"2024-09-11T14:44:05.716117+0000","last_became_peered":"2024-09-11T14:44:05.716117+0000","last_unstale":"2024-09-11T14:58:37.797045+0000","last_undegraded":"2024-09-11T14:58:37.797045+0000","last_fullsized":"2024-09-11T14:58:37.797045+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.826611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.826611+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.309657+0000","last_change":"2024-09-11T14:58:38.344884+0000","last_active":"2024-09-11T14:58:38.309657+0000","last_peered":"2024-09-11T14:58:38.309657+0000","last_clean":"2024-09-11T14:58:38.309657+0000","last_became_active":"2024-09-11T14:44:05.809065+0000","last_became_peered":"2024-09-11T14:44:05.809065+0000","last_unstale":"2024-09-11T14:58:38.309657+0000","last_undegraded":"2024-09-11T14:58:38.309657+0000","last_fullsized":"2024-09-11T14:58:38.309657+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.344572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.344572+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.795287+0000","last_change":"2024-09-11T14:58:36.840390+0000","last_active":"2024-09-11T14:58:36.795287+0000","last_peered":"2024-09-11T14:58:36.795287+0000","last_clean":"2024-09-11T14:58:36.795287+0000","last_became_active":"2024-09-11T14:44:05.807629+0000","last_became_peered":"2024-09-11T14:44:05.807629+0000","last_unstale":"2024-09-11T14:58:36.795287+0000","last_undegraded":"2024-09-11T14:58:36.795287+0000","last_fullsized":"2024-09-11T14:58:36.795287+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.840201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.840201+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.306999+0000","last_change":"2024-09-11T14:58:38.369482+0000","last_active":"2024-09-11T14:58:38.306999+0000","last_peered":"2024-09-11T14:58:38.306999+0000","last_clean":"2024-09-11T14:58:38.306999+0000","last_became_active":"2024-09-11T14:44:05.923287+0000","last_became_peered":"2024-09-11T14:44:05.923287+0000","last_unstale":"2024-09-11T14:58:38.306999+0000","last_undegraded":"2024-09-11T14:58:38.306999+0000","last_fullsized":"2024-09-11T14:58:38.306999+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.369331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.369331+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.304923+0000","last_change":"2024-09-11T14:58:38.365124+0000","last_active":"2024-09-11T14:58:38.304923+0000","last_peered":"2024-09-11T14:58:38.304923+0000","last_clean":"2024-09-11T14:58:38.304923+0000","last_became_active":"2024-09-11T14:44:05.802531+0000","last_became_peered":"2024-09-11T14:44:05.802531+0000","last_unstale":"2024-09-11T14:58:38.304923+0000","last_undegraded":"2024-09-11T14:58:38.304923+0000","last_fullsized":"2024-09-11T14:58:38.304923+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.364954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.364954+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.800020+0000","last_change":"2024-09-11T14:58:36.855207+0000","last_active":"2024-09-11T14:58:36.800020+0000","last_peered":"2024-09-11T14:58:36.800020+0000","last_clean":"2024-09-11T14:58:36.800020+0000","last_became_active":"2024-09-11T14:44:05.865190+0000","last_became_peered":"2024-09-11T14:44:05.865190+0000","last_unstale":"2024-09-11T14:58:36.800020+0000","last_undegraded":"2024-09-11T14:58:36.800020+0000","last_fullsized":"2024-09-11T14:58:36.800020+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.855042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.855042+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.797268+0000","last_change":"2024-09-11T14:58:36.854383+0000","last_active":"2024-09-11T14:58:36.797268+0000","last_peered":"2024-09-11T14:58:36.797268+0000","last_clean":"2024-09-11T14:58:36.797268+0000","last_became_active":"2024-09-11T14:44:05.784807+0000","last_became_peered":"2024-09-11T14:44:05.784807+0000","last_unstale":"2024-09-11T14:58:36.797268+0000","last_undegraded":"2024-09-11T14:58:36.797268+0000","last_fullsized":"2024-09-11T14:58:36.797268+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.854205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.854205+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.795638+0000","last_change":"2024-09-11T14:58:36.848698+0000","last_active":"2024-09-11T14:58:36.795638+0000","last_peered":"2024-09-11T14:58:36.795638+0000","last_clean":"2024-09-11T14:58:36.795638+0000","last_became_active":"2024-09-11T14:44:05.775468+0000","last_became_peered":"2024-09-11T14:44:05.775468+0000","last_unstale":"2024-09-11T14:58:36.795638+0000","last_undegraded":"2024-09-11T14:58:36.795638+0000","last_fullsized":"2024-09-11T14:58:36.795638+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.848502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.848502+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.304353+0000","last_change":"2024-09-11T14:58:38.336037+0000","last_active":"2024-09-11T14:58:38.304353+0000","last_peered":"2024-09-11T14:58:38.304353+0000","last_clean":"2024-09-11T14:58:38.304353+0000","last_became_active":"2024-09-11T14:44:05.723386+0000","last_became_peered":"2024-09-11T14:44:05.723386+0000","last_unstale":"2024-09-11T14:58:38.304353+0000","last_undegraded":"2024-09-11T14:58:38.304353+0000","last_fullsized":"2024-09-11T14:58:38.304353+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.335872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.335872+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.795555+0000","last_change":"2024-09-11T14:58:37.835622+0000","last_active":"2024-09-11T14:58:37.795555+0000","last_peered":"2024-09-11T14:58:37.795555+0000","last_clean":"2024-09-11T14:58:37.795555+0000","last_became_active":"2024-09-11T14:44:05.669284+0000","last_became_peered":"2024-09-11T14:44:05.669284+0000","last_unstale":"2024-09-11T14:58:37.795555+0000","last_undegraded":"2024-09-11T14:58:37.795555+0000","last_fullsized":"2024-09-11T14:58:37.795555+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.835432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.835432+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.297544+0000","last_change":"2024-09-11T14:58:37.324835+0000","last_active":"2024-09-11T14:58:37.297544+0000","last_peered":"2024-09-11T14:58:37.297544+0000","last_clean":"2024-09-11T14:58:37.297544+0000","last_became_active":"2024-09-11T14:44:05.720000+0000","last_became_peered":"2024-09-11T14:44:05.720000+0000","last_unstale":"2024-09-11T14:58:37.297544+0000","last_undegraded":"2024-09-11T14:58:37.297544+0000","last_fullsized":"2024-09-11T14:58:37.297544+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.324613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.324613+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.293837+0000","last_change":"2024-09-11T14:58:37.337175+0000","last_active":"2024-09-11T14:58:37.293837+0000","last_peered":"2024-09-11T14:58:37.293837+0000","last_clean":"2024-09-11T14:58:37.293837+0000","last_became_active":"2024-09-11T14:44:05.994115+0000","last_became_peered":"2024-09-11T14:44:05.994115+0000","last_unstale":"2024-09-11T14:58:37.293837+0000","last_undegraded":"2024-09-11T14:58:37.293837+0000","last_fullsized":"2024-09-11T14:58:37.293837+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.336988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.336988+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.296071+0000","last_change":"2024-09-11T14:58:37.339573+0000","last_active":"2024-09-11T14:58:37.296071+0000","last_peered":"2024-09-11T14:58:37.296071+0000","last_clean":"2024-09-11T14:58:37.296071+0000","last_became_active":"2024-09-11T14:44:05.719555+0000","last_became_peered":"2024-09-11T14:44:05.719555+0000","last_unstale":"2024-09-11T14:58:37.296071+0000","last_undegraded":"2024-09-11T14:58:37.296071+0000","last_fullsized":"2024-09-11T14:58:37.296071+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.339251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.339251+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.798438+0000","last_change":"2024-09-11T14:58:37.838971+0000","last_active":"2024-09-11T14:58:37.798438+0000","last_peered":"2024-09-11T14:58:37.798438+0000","last_clean":"2024-09-11T14:58:37.798438+0000","last_became_active":"2024-09-11T14:44:05.643040+0000","last_became_peered":"2024-09-11T14:44:05.643040+0000","last_unstale":"2024-09-11T14:58:37.798438+0000","last_undegraded":"2024-09-11T14:58:37.798438+0000","last_fullsized":"2024-09-11T14:58:37.798438+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.838772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.838772+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.304306+0000","last_change":"2024-09-11T14:58:38.355156+0000","last_active":"2024-09-11T14:58:38.304306+0000","last_peered":"2024-09-11T14:58:38.304306+0000","last_clean":"2024-09-11T14:58:38.304306+0000","last_became_active":"2024-09-11T14:44:05.827738+0000","last_became_peered":"2024-09-11T14:44:05.827738+0000","last_unstale":"2024-09-11T14:58:38.304306+0000","last_undegraded":"2024-09-11T14:58:38.304306+0000","last_fullsized":"2024-09-11T14:58:38.304306+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.354890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.354890+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.302015+0000","last_change":"2024-09-11T14:58:38.364329+0000","last_active":"2024-09-11T14:58:38.302015+0000","last_peered":"2024-09-11T14:58:38.302015+0000","last_clean":"2024-09-11T14:58:38.302015+0000","last_became_active":"2024-09-11T14:44:05.636002+0000","last_became_peered":"2024-09-11T14:44:05.636002+0000","last_unstale":"2024-09-11T14:58:38.302015+0000","last_undegraded":"2024-09-11T14:58:38.302015+0000","last_fullsized":"2024-09-11T14:58:38.302015+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.364160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.364160+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.793457+0000","last_change":"2024-09-11T14:58:36.820763+0000","last_active":"2024-09-11T14:58:36.793457+0000","last_peered":"2024-09-11T14:58:36.793457+0000","last_clean":"2024-09-11T14:58:36.793457+0000","last_became_active":"2024-09-11T14:44:05.735069+0000","last_became_peered":"2024-09-11T14:44:05.735069+0000","last_unstale":"2024-09-11T14:58:36.793457+0000","last_undegraded":"2024-09-11T14:58:36.793457+0000","last_fullsized":"2024-09-11T14:58:36.793457+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.820571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.820571+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.302792+0000","last_change":"2024-09-11T14:58:38.333183+0000","last_active":"2024-09-11T14:58:38.302792+0000","last_peered":"2024-09-11T14:58:38.302792+0000","last_clean":"2024-09-11T14:58:38.302792+0000","last_became_active":"2024-09-11T14:44:05.746996+0000","last_became_peered":"2024-09-11T14:44:05.746996+0000","last_unstale":"2024-09-11T14:58:38.302792+0000","last_undegraded":"2024-09-11T14:58:38.302792+0000","last_fullsized":"2024-09-11T14:58:38.302792+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.332853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.332853+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.790252+0000","last_change":"2024-09-11T14:58:36.833268+0000","last_active":"2024-09-11T14:58:36.790252+0000","last_peered":"2024-09-11T14:58:36.790252+0000","last_clean":"2024-09-11T14:58:36.790252+0000","last_became_active":"2024-09-11T14:44:05.698451+0000","last_became_peered":"2024-09-11T14:44:05.698451+0000","last_unstale":"2024-09-11T14:58:36.790252+0000","last_undegraded":"2024-09-11T14:58:36.790252+0000","last_fullsized":"2024-09-11T14:58:36.790252+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.833072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.833072+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.791331+0000","last_change":"2024-09-11T14:58:36.849597+0000","last_active":"2024-09-11T14:58:36.791331+0000","last_peered":"2024-09-11T14:58:36.791331+0000","last_clean":"2024-09-11T14:58:36.791331+0000","last_became_active":"2024-09-11T14:44:05.745807+0000","last_became_peered":"2024-09-11T14:44:05.745807+0000","last_unstale":"2024-09-11T14:58:36.791331+0000","last_undegraded":"2024-09-11T14:58:36.791331+0000","last_fullsized":"2024-09-11T14:58:36.791331+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.849431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.849431+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.788549+0000","last_change":"2024-09-11T14:58:36.834904+0000","last_active":"2024-09-11T14:58:36.788549+0000","last_peered":"2024-09-11T14:58:36.788549+0000","last_clean":"2024-09-11T14:58:36.788549+0000","last_became_active":"2024-09-11T14:44:05.775888+0000","last_became_peered":"2024-09-11T14:44:05.775888+0000","last_unstale":"2024-09-11T14:58:36.788549+0000","last_undegraded":"2024-09-11T14:58:36.788549+0000","last_fullsized":"2024-09-11T14:58:36.788549+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.834721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.834721+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1493,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.294455+0000","last_change":"2024-09-11T14:58:37.343113+0000","last_active":"2024-09-11T14:58:37.294455+0000","last_peered":"2024-09-11T14:58:37.294455+0000","last_clean":"2024-09-11T14:58:37.294455+0000","last_became_active":"2024-09-11T14:44:05.661592+0000","last_became_peered":"2024-09-11T14:44:05.661592+0000","last_unstale":"2024-09-11T14:58:37.294455+0000","last_undegraded":"2024-09-11T14:58:37.294455+0000","last_fullsized":"2024-09-11T14:58:37.294455+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"241'7","last_scrub_stamp":"2024-09-11T14:58:37.342902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.342902+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1480,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.797095+0000","last_change":"2024-09-11T14:58:37.837555+0000","last_active":"2024-09-11T14:58:37.797095+0000","last_peered":"2024-09-11T14:58:37.797095+0000","last_clean":"2024-09-11T14:58:37.797095+0000","last_became_active":"2024-09-11T14:44:05.719933+0000","last_became_peered":"2024-09-11T14:44:05.719933+0000","last_unstale":"2024-09-11T14:58:37.797095+0000","last_undegraded":"2024-09-11T14:58:37.797095+0000","last_fullsized":"2024-09-11T14:58:37.797095+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.837380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.837380+0000","last_clean_scrub_stamp":"2024-09-11T14:44:04.501737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2165,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.291228+0000","last_change":"2024-09-11T14:58:37.321193+0000","last_active":"2024-09-11T14:58:37.291228+0000","last_peered":"2024-09-11T14:58:37.291228+0000","last_clean":"2024-09-11T14:58:37.291228+0000","last_became_active":"2024-09-11T14:38:48.665265+0000","last_became_peered":"2024-09-11T14:38:48.665265+0000","last_unstale":"2024-09-11T14:58:37.291228+0000","last_undegraded":"2024-09-11T14:58:37.291228+0000","last_fullsized":"2024-09-11T14:58:37.291228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.320833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.320833+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2165,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.793785+0000","last_change":"2024-09-11T14:58:37.827790+0000","last_active":"2024-09-11T14:58:37.793785+0000","last_peered":"2024-09-11T14:58:37.793785+0000","last_clean":"2024-09-11T14:58:37.793785+0000","last_became_active":"2024-09-11T14:38:48.666536+0000","last_became_peered":"2024-09-11T14:38:48.666536+0000","last_unstale":"2024-09-11T14:58:37.793785+0000","last_undegraded":"2024-09-11T14:58:37.793785+0000","last_fullsized":"2024-09-11T14:58:37.793785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.827461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.827461+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2165,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.301755+0000","last_change":"2024-09-11T14:58:38.348037+0000","last_active":"2024-09-11T14:58:38.301755+0000","last_peered":"2024-09-11T14:58:38.301755+0000","last_clean":"2024-09-11T14:58:38.301755+0000","last_became_active":"2024-09-11T14:38:48.665224+0000","last_became_peered":"2024-09-11T14:38:48.665224+0000","last_unstale":"2024-09-11T14:58:38.301755+0000","last_undegraded":"2024-09-11T14:58:38.301755+0000","last_fullsized":"2024-09-11T14:58:38.301755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:38.347853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.347853+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2165,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.791268+0000","last_change":"2024-09-11T14:58:37.832382+0000","last_active":"2024-09-11T14:58:37.791268+0000","last_peered":"2024-09-11T14:58:37.791268+0000","last_clean":"2024-09-11T14:58:37.791268+0000","last_became_active":"2024-09-11T14:38:48.652452+0000","last_became_peered":"2024-09-11T14:38:48.652452+0000","last_unstale":"2024-09-11T14:58:37.791268+0000","last_undegraded":"2024-09-11T14:58:37.791268+0000","last_fullsized":"2024-09-11T14:58:37.791268+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.832198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.832198+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2165,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.788294+0000","last_change":"2024-09-11T14:58:36.842099+0000","last_active":"2024-09-11T14:58:36.788294+0000","last_peered":"2024-09-11T14:58:36.788294+0000","last_clean":"2024-09-11T14:58:36.788294+0000","last_became_active":"2024-09-11T14:38:48.679068+0000","last_became_peered":"2024-09-11T14:38:48.679068+0000","last_unstale":"2024-09-11T14:58:36.788294+0000","last_undegraded":"2024-09-11T14:58:36.788294+0000","last_fullsized":"2024-09-11T14:58:36.788294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-11T14:58:36.841899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.841899+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2165,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.289123+0000","last_change":"2024-09-11T14:58:37.331513+0000","last_active":"2024-09-11T14:58:37.289123+0000","last_peered":"2024-09-11T14:58:37.289123+0000","last_clean":"2024-09-11T14:58:37.289123+0000","last_became_active":"2024-09-11T14:38:48.648119+0000","last_became_peered":"2024-09-11T14:38:48.648119+0000","last_unstale":"2024-09-11T14:58:37.289123+0000","last_undegraded":"2024-09-11T14:58:37.289123+0000","last_fullsized":"2024-09-11T14:58:37.289123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:37.331321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.331321+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2163,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:36.788289+0000","last_change":"2024-09-11T14:58:36.825762+0000","last_active":"2024-09-11T14:58:36.788289+0000","last_peered":"2024-09-11T14:58:36.788289+0000","last_clean":"2024-09-11T14:58:36.788289+0000","last_became_active":"2024-09-11T14:38:48.695925+0000","last_became_peered":"2024-09-11T14:38:48.695925+0000","last_unstale":"2024-09-11T14:58:36.788289+0000","last_undegraded":"2024-09-11T14:58:36.788289+0000","last_fullsized":"2024-09-11T14:58:36.788289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:58:36.825420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:36.825420+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2166,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:37.291230+0000","last_change":"2024-09-11T14:58:37.336871+0000","last_active":"2024-09-11T14:58:37.291230+0000","last_peered":"2024-09-11T14:58:37.291230+0000","last_clean":"2024-09-11T14:58:37.291230+0000","last_became_active":"2024-09-11T14:38:48.669212+0000","last_became_peered":"2024-09-11T14:38:48.669212+0000","last_unstale":"2024-09-11T14:58:37.291230+0000","last_undegraded":"2024-09-11T14:58:37.291230+0000","last_fullsized":"2024-09-11T14:58:37.291230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-11T14:58:37.336506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:37.336506+0000","last_clean_scrub_stamp":"2024-09-11T14:38:47.563225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2237,"reported_epoch":731,"state":"active+clean","last_fresh":"2024-09-11T14:58:38.299825+0000","last_change":"2024-09-11T14:58:38.391044+0000","last_active":"2024-09-11T14:58:38.299825+0000","last_peered":"2024-09-11T14:58:38.299825+0000","last_clean":"2024-09-11T14:58:38.299825+0000","last_became_active":"2024-09-11T14:38:46.628576+0000","last_became_peered":"2024-09-11T14:38:46.628576+0000","last_unstale":"2024-09-11T14:58:38.299825+0000","last_undegraded":"2024-09-11T14:58:38.299825+0000","last_fullsized":"2024-09-11T14:58:38.299825+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-11T14:58:38.390851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:58:38.390851+0000","last_clean_scrub_stamp":"2024-09-11T14:38:45.555142+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187986944,"internally_reserved":0,"allocated":23506944,"data_stored":23506944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187986944,"internally_reserved":0,"allocated":23506944,"data_stored":23506944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6080,"kb_used_data":6080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291648,"statfs":{"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5216,"kb_used_data":5216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292512,"statfs":{"total":53552873472,"available":53547532288,"internally_reserved":0,"allocated":5341184,"data_stored":5341184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5188,"kb_used_data":5188,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292540,"statfs":{"total":53552873472,"available":53547560960,"internally_reserved":0,"allocated":5312512,"data_stored":5312512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6472,"kb_used_data":6472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291256,"statfs":{"total":53552873472,"available":53546246144,"internally_reserved":0,"allocated":6627328,"data_stored":6627328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53546246144,"internally_reserved":0,"allocated":6627328,"data_stored":6627328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547560960,"internally_reserved":0,"allocated":5312512,"data_stored":5312512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547532288,"internally_reserved":0,"allocated":5341184,"data_stored":5341184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53546246144,"internally_reserved":0,"allocated":6627328,"data_stored":6627328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547560960,"internally_reserved":0,"allocated":5312512,"data_stored":5312512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547532288,"internally_reserved":0,"allocated":5341184,"data_stored":5341184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546647552,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:58:59.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T14:58:59.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.105+0000 7f4632791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.114+0000 7f4632791640 1 Processor -- start 2024-09-11T14:58:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.114+0000 7f4632791640 1 -- start start 2024-09-11T14:58:59.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f4632791640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f462c0a1fc0 0x7f462c073010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f4632791640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462c0743d0 con 0x7f462c073550 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f4632791640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f462c0740c0 con 0x7f462c0a1fc0 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f462c0a1fc0 0x7f462c073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f462c0a1fc0 0x7f462c073010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44088/0 (socket says 172.21.15.52:44088) 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f4623fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f462c073550 0x7f462c135d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58220/0 (socket says 172.21.15.52:58220) 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462bfff640 1 -- 172.21.15.52:0/1816306623 learned_addr learned my addr 172.21.15.52:0/1816306623 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462bfff640 1 -- 172.21.15.52:0/1816306623 >> v1:172.21.15.52:6789/0 conn(0x7f462c073550 legacy=0x7f462c135d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462bfff640 1 -- 172.21.15.52:0/1816306623 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0a3270 con 0x7f462c0a1fc0 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462bfff640 1 --2- 172.21.15.52:0/1816306623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c0a1fc0 0x7f462c073010 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf3dc11921e57c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.116+0000 7f462b7fe640 1 -- 172.21.15.52:0/1816306623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f461c009e50 con 0x7f462c0a1fc0 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f462b7fe640 1 -- 172.21.15.52:0/1816306623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f461c00e230 con 0x7f462c0a1fc0 2024-09-11T14:58:59.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f462b7fe640 1 -- 172.21.15.52:0/1816306623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f461c00e4d0 con 0x7f462c0a1fc0 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 -- 172.21.15.52:0/1816306623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c0a1fc0 msgr2=0x7f462c073010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 --2- 172.21.15.52:0/1816306623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c0a1fc0 0x7f462c073010 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 -- 172.21.15.52:0/1816306623 shutdown_connections 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 --2- 172.21.15.52:0/1816306623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c0a1fc0 0x7f462c073010 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 -- 172.21.15.52:0/1816306623 >> 172.21.15.52:0/1816306623 conn(0x7f462c06f0a0 msgr2=0x7f462c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 -- 172.21.15.52:0/1816306623 shutdown_connections 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.117+0000 7f4632791640 1 -- 172.21.15.52:0/1816306623 wait complete. 2024-09-11T14:58:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.118+0000 7f4632791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:58:59.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.119+0000 7f4632791640 1 Processor -- start 2024-09-11T14:58:59.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.119+0000 7f4632791640 1 -- start start 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.121+0000 7f4632791640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 0x7f462c126a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.121+0000 7f4632791640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f462c125350 con 0x7f462c073550 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.121+0000 7f462bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 0x7f462c126a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.121+0000 7f462bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 0x7f462c126a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44102/0 (socket says 172.21.15.52:44102) 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.121+0000 7f462bfff640 1 -- 172.21.15.52:0/3217817934 learned_addr learned my addr 172.21.15.52:0/3217817934 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.121+0000 7f462bfff640 1 -- 172.21.15.52:0/3217817934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c124af0 con 0x7f462c073550 2024-09-11T14:58:59.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.122+0000 7f462bfff640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 0x7f462c126a90 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.122+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f461c00edd0 con 0x7f462c073550 2024-09-11T14:58:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.122+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f461c015420 con 0x7f462c073550 2024-09-11T14:58:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.122+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c125c00 con 0x7f462c073550 2024-09-11T14:58:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.122+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f461c0156c0 con 0x7f462c073550 2024-09-11T14:58:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.122+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c126310 con 0x7f462c073550 2024-09-11T14:58:59.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.123+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f461c015870 con 0x7f462c073550 2024-09-11T14:58:59.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.123+0000 7f46297fa640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f460c03e930 0x7f460c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:58:59.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.123+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c073010 con 0x7f462c073550 2024-09-11T14:58:59.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.123+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(731..731 src has 681..731) ==== 3431+0+0 (crc 0 0 0) 0x7f461c051120 con 0x7f462c073550 2024-09-11T14:58:59.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.123+0000 7f4623fff640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f460c03e930 0x7f460c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:58:59.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.124+0000 7f4623fff640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f460c03e930 0x7f460c040e40 crc :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:58:59.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.128+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f461c014c10 con 0x7f462c073550 2024-09-11T14:58:59.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.314+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f462c1277a0 con 0x7f462c073550 2024-09-11T14:58:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.317+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f461c010310 con 0x7f462c073550 2024-09-11T14:58:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.318+0000 7f46297fa640 1 -- 172.21.15.52:0/3217817934 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f461c014c10 con 0x7f462c073550 2024-09-11T14:58:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f460c03e930 msgr2=0x7f460c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f460c03e930 0x7f460c040e40 crc :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 msgr2=0x7f462c126a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 0x7f462c126a90 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 shutdown_connections 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.143:6800/310319615,v1:172.21.15.143:6801/310319615] conn(0x7f460c03e930 0x7f460c040e40 unknown :-1 s=CLOSED pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 --2- 172.21.15.52:0/3217817934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462c073550 0x7f462c126a90 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 >> 172.21.15.52:0/3217817934 conn(0x7f462c06f0a0 msgr2=0x7f462c070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 shutdown_connections 2024-09-11T14:58:59.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-11T14:58:59.320+0000 7f4632791640 1 -- 172.21.15.52:0/3217817934 wait complete. 2024-09-11T14:58:59.336 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T14:58:59.336 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T14:58:59.336 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T14:58:59.336 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:58:59.419 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T14:58:59.419 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T14:58:59.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:58:59.498 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T14:58:59.498 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T14:58:59.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:58:59.574 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T14:58:59.574 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T14:58:59.574 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:58:59.651 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T14:58:59.651 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T14:58:59.651 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T14:58:59.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:58:59.680 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T14:58:59.681 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T14:58:59.681 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T14:58:59.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:58:59.695 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T14:58:59.695 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T14:58:59.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-11T14:58:59.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:58:59.765 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T14:59:00.035 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:59:00.035 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T14:59:00.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:59:00.117 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T14:59:00.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:59:00.248 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T14:59:00.346 INFO:tasks.ceph:Archiving mon data... 2024-09-11T14:59:00.347 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/data/mon.a.tgz 2024-09-11T14:59:00.347 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-11T14:59:00.364 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.hMtovCnozz 2024-09-11T14:59:00.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hMtovCnozz 2024-09-11T14:59:00.640 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.hMtovCnozz 2024-09-11T14:59:00.729 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.hMtovCnozz is 306KB 2024-09-11T14:59:00.824 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.hMtovCnozz 2024-09-11T14:59:00.840 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T14:59:00.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:59:00.882 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:59:00.961 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:59:00.979 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:59:00.979 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T14:59:00.981 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/remote/smithi052/crash 2024-09-11T14:59:00.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:59:01.026 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/remote/smithi143/crash 2024-09-11T14:59:01.026 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:59:01.066 INFO:tasks.ceph:Compressing logs... 2024-09-11T14:59:01.067 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:59:01.070 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:59:01.094 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T14:59:01.094 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30912.log 2024-09-11T14:59:01.094 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28882.log 2024-09-11T14:59:01.095 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.30912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93286.log 2024-09-11T14:59:01.095 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29051.log 2024-09-11T14:59:01.095 INFO:teuthology.orchestra.run.smithi052.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28882.log.gz 2024-09-11T14:59:01.095 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96152.log 2024-09-11T14:59:01.095 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93286.log: /var/log/ceph/ceph-client.admin.29051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96887.log 2024-09-11T14:59:01.145 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28106.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28066.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.28106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28015.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.28066.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28106.log.gz 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28146.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.28066.log.gz 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.28015.log: /var/log/ceph/ceph-client.admin.28146.log: /var/log/ceph/ceph-osd.2.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28146.log.gz 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T14:59:01.146 INFO:teuthology.orchestra.run.smithi143.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28015.log.gz 2024-09-11T14:59:01.162 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29051.log.gz 2024-09-11T14:59:01.162 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95965.log 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28782.log 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96887.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96152.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.30912.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95965.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96887.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96388.log 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93286.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28605.log 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.95965.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28782.log: /var/log/ceph/ceph-client.admin.96388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94018.log 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28782.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96388.log.gz 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94383.log 2024-09-11T14:59:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28572.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28605.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94383.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94018.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28698.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94383.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94400.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28572.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28274.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28698.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94295.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93200.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28274.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29631.log 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.94295.log.gz 2024-09-11T14:59:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28884.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94400.log.gz 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29631.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94258.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr: 86.7%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.28884.log.gz 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93180.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93200.log.gz 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93929.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94258.log: /var/log/ceph/ceph-client.admin.93180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29049.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.94258.log.gz 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93141.log 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.93929.log.gz 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29049.log: gzip -5 --verbose -- 90.4% -- replaced with /var/log/ceph/ceph-client.admin.93180.log.gz 2024-09-11T14:59:01.165 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.96257.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29049.log.gz 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96342.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94017.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93141.log.gz 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96257.log.gz 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94153.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94017.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96342.log.gz 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30931.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96635.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.30931.log: -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94017.log.gz 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.96413.log 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94153.log.gz 2024-09-11T14:59:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96635.log: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.30931.log.gz -5 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93967.log 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96635.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97055.log 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.29631.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.96413.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97013.log 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28516.log 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97055.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.93967.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95745.log 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97013.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95939.log 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28516.log.gz 2024-09-11T14:59:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29050.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95745.log: /var/log/ceph/ceph-client.admin.95939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31047.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95745.log.gz 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.95939.log.gz 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93930.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29050.log.gz 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96551.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31047.log: /var/log/ceph/ceph-client.admin.93930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93783.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96551.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93930.log.gz 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96551.log.gz 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94724.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94331.log 2024-09-11T14:59:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95703.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28459.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94331.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95703.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95703.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96845.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28459.log: -- /var/log/ceph/ceph-client.admin.95874.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96845.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28459.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95850.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.96845.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94724.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29052.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95874.log: /var/log/ceph/ceph-client.admin.95850.log: gzip 86.4% -- replaced with /var/log/ceph/ceph-client.admin.95874.log.gz 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96173.log 2024-09-11T14:59:01.169 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95850.log.gz 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29052.log: gzip -5 --verbose -- 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29052.log.gz /var/log/ceph/ceph-client.admin.95574.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93337.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96173.log.gz 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96438.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95574.log.gz 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95829.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28740.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr: 86.5%/var/log/ceph/ceph-client.admin.95829.log: -- replaced with /var/log/ceph/ceph-client.admin.96438.log.gz 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95228.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95829.log.gz 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94154.log 2024-09-11T14:59:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28740.log: /var/log/ceph/ceph-client.admin.95228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94019.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94154.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28740.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95964.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94154.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94019.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94019.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.93337.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94294.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.95964.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29412.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: 91.5% 92.8% -- replaced with /var/log/ceph/ceph-client.admin.95228.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93783.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96677.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95964.log.gz 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94068.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2%/var/log/ceph/ceph-client.admin.96677.log: -- replaced with /var/log/ceph/ceph-client.admin.29412.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30970.log 2024-09-11T14:59:01.171 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94294.log.gz 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96677.log.gz 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94676.log 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30878.log 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94676.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93966.log 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94068.log.gz 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28195.log 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29219.log 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93966.log: /var/log/ceph/ceph-client.admin.28195.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30878.log.gz 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28195.log.gz 2024-09-11T14:59:01.172 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29370.log 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93966.log.gz 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96803.log 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr: 85.8%/var/log/ceph/ceph-client.admin.29370.log: -- replaced with /var/log/ceph/ceph-client.admin.29219.log.gz 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96105.log 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29370.log.gz 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96215.log 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96803.log.gz 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96194.log 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96105.log.gz 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94330.log 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96215.log.gz 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94447.log 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96194.log: /var/log/ceph/ceph-client.admin.94330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96278.log 2024-09-11T14:59:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94447.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96194.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94447.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94330.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.96236.log 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92986.log 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96236.log: /var/log/ceph/ceph-client.admin.96278.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.94676.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28656.log 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96236.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96299.log 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96278.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28656.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96299.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28656.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.92986.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94221.log 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96299.log.gz 2024-09-11T14:59:01.174 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29218.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.30970.log.gz 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95015.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94221.log: /var/log/ceph/ceph-client.admin.29218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97097.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29218.log.gzgzip 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96593.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94221.log.gz 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95015.log: /var/log/ceph/ceph-client.admin.97097.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97097.log.gz 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95600.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29220.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr: 85.7%/var/log/ceph/ceph-client.admin.95600.log: -- replaced with /var/log/ceph/ceph-client.admin.96593.log.gz 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95395.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95600.log.gz 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93968.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29220.log: /var/log/ceph/ceph-client.admin.95395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94155.log 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29220.log.gz 2024-09-11T14:59:01.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93968.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95395.log.gz 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31028.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95682.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31028.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.95015.log.gz 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94155.log.gz 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93968.log.gz 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95636.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31028.log.gz 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94464.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95682.log.gz 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92767.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95636.log.gz 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94464.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92805.log 2024-09-11T14:59:01.176 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96055.log 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92767.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92805.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94464.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.92805.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94222.log 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94072.log 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96055.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94222.log: gzip 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96719.log 85.6% -- replaced with /var/log/ceph/ceph-client.admin.94222.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95918.log 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96719.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96131.log 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94072.log.gz 2024-09-11T14:59:01.177 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96719.log.gz 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96320.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95918.log.gz 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93672.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96131.log: /var/log/ceph/ceph-client.admin.96320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93023.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96761.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96320.log.gz 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96131.log.gz 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93931.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96081.log 85.5% -- replaced with /var/log/ceph/ceph-client.admin.96761.log.gz 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.93672.log.gz 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97137.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93931.log: gzip/var/log/ceph/ceph-client.admin.96081.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96033.log 2024-09-11T14:59:01.178 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97137.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96081.log.gz 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93023.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28883.log 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.97137.log.gz 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.93931.log.gz 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96033.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27409.log 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96033.log.gz 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94907.log 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28883.log: /var/log/ceph/ceph.tmp-client.admin.27409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96971.log 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28883.log.gz 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27409.log.gz 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95766.log 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95661.log 2024-09-11T14:59:01.179 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94332.log 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96971.log.gz 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95766.log.gz 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95661.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.94907.log.gz 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95661.log.gz 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94257.log 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95873.log 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95427.log 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94332.log.gz 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93910.log 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95873.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94257.log.gz 2024-09-11T14:59:01.180 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28430.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95427.log: /var/log/ceph/ceph-client.admin.93910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30101.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31008.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr: 84.6%/var/log/ceph/ceph-client.admin.30101.log: -- replaced with /var/log/ceph/ceph-client.admin.28430.log.gz 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.93910.log.gz 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28881.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94070.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31008.log.gz 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96009.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94070.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28881.log.gz 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95724.log 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94070.log.gz 2024-09-11T14:59:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96009.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96009.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93219.log 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29328.log 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95724.log: /var/log/ceph/ceph-client.admin.93219.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95724.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93160.log 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29328.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29328.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96929.log 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr: 90.6%/var/log/ceph/ceph-client.admin.93160.log: -- replaced with /var/log/ceph/ceph-client.admin.93219.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93160.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95808.log 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94069.log 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95808.log: 93.2%/var/log/ceph/ceph-client.admin.96929.log: -- replaced with /var/log/ceph/ceph-client.admin.95427.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95808.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96929.log.gz 2024-09-11T14:59:01.182 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92693.log 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29160.log 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94069.log: gzip/var/log/ceph/ceph-client.admin.92693.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96363.log 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29160.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29160.log.gz 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94069.log.gz 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95787.log 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94071.log 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.96363.log: /var/log/ceph/ceph-client.admin.95787.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96363.log.gz 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95787.log.gz 2024-09-11T14:59:01.183 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94071.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94071.log.gz 2024-09-11T14:59:01.184 INFO:teuthology.orchestra.run.smithi052.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.30101.log.gz 2024-09-11T14:59:01.184 INFO:teuthology.orchestra.run.smithi052.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.92693.log.gz 2024-09-11T14:59:01.356 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.3.log: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T14:59:01.548 INFO:teuthology.orchestra.run.smithi052.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31047.log.gz 2024-09-11T14:59:02.726 INFO:teuthology.orchestra.run.smithi052.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T14:59:09.034 INFO:teuthology.orchestra.run.smithi143.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T14:59:09.791 INFO:teuthology.orchestra.run.smithi143.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T14:59:09.792 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-11T14:59:09.793 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m8.667s 2024-09-11T14:59:09.793 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m16.139s 2024-09-11T14:59:09.793 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m0.615s 2024-09-11T14:59:10.025 INFO:teuthology.orchestra.run.smithi052.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T14:59:11.182 INFO:teuthology.orchestra.run.smithi052.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T14:59:11.184 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T14:59:11.184 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m10.101s 2024-09-11T14:59:11.184 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m20.512s 2024-09-11T14:59:11.184 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.778s 2024-09-11T14:59:11.184 INFO:tasks.ceph:Archiving logs... 2024-09-11T14:59:11.185 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/remote/smithi052/log 2024-09-11T14:59:11.186 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:59:14.864 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/remote/smithi143/log 2024-09-11T14:59:14.864 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:59:17.711 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T14:59:17.719 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T14:59:17.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:59:17.722 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:59:17.821 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T14:59:17.829 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T14:59:17.830 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:59:17.832 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:59:17.848 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:59:17.849 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:59:17.852 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:59:17.853 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-11T14:59:17.853 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 +1190us[+1169us] +/- 65ms 2024-09-11T14:59:17.853 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -625us[ -646us] +/- 64ms 2024-09-11T14:59:17.853 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -492us[ -513us] +/- 63ms 2024-09-11T14:59:17.853 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:59:17.854 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:59:17.854 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-11T14:59:17.855 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1177us[+1164us] +/- 65ms 2024-09-11T14:59:17.855 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -630us[ -643us] +/- 64ms 2024-09-11T14:59:17.855 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -462us[ -462us] +/- 63ms 2024-09-11T14:59:17.855 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:59:17.855 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T14:59:17.864 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T14:59:17.865 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T14:59:17.882 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:59:17.966 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:59:18.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:59:18.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:59:18.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T14:59:18.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:59:18.095 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T14:59:18.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T14:59:18.123 INFO:teuthology.task.internal:Duration was 1667.403247 seconds 2024-09-11T14:59:18.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T14:59:18.182 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T14:59:18.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:59:18.185 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:59:18.227 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:59:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:59:18.506 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T14:59:18.506 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T14:59:18.506 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:59:18.529 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-09-11T14:59:18.529 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:59:18.575 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T14:59:18.575 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:59:18.577 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:59:18.642 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T14:59:18.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:59:18.647 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:59:18.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T14:59:18.789 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T14:59:18.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:59:18.814 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:59:18.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T14:59:18.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:59:18.865 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:59:18.879 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-11T14:59:18.902 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-09-11T14:59:18.924 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:59:18.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:59:18.952 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:59:18.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:59:18.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T14:59:18.989 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T14:59:18.990 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/remote/smithi052 2024-09-11T14:59:18.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:59:19.027 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:56:22-crimson-rados-main-distro-crimson-smithi/7901369/remote/smithi143 2024-09-11T14:59:19.027 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:59:19.059 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T14:59:19.060 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:59:19.064 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:59:19.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T14:59:19.119 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T14:59:19.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T14:59:19.141 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T14:59:19.141 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:59:19.143 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:59:19.156 INFO:teuthology.orchestra.run.smithi052.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:59 /home/ubuntu/cephtest 2024-09-11T14:59:19.164 INFO:teuthology.orchestra.run.smithi143.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:59 /home/ubuntu/cephtest 2024-09-11T14:59:19.165 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T14:59:19.174 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T14:59:19.243 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests} duration: 1667.4032473564148 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-11T14:59:19.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:59:19.332 INFO:teuthology.run:pass