2024-09-16T16:32:27.855 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T16:32:27.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:32:27.957 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7907361' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6678 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+6CltMic5kh/l8tyWpFi6n7MgFl713vNqHaObWLotSOCb3oRLelgI25WTtajIB+0ZRXDzUfEb+ADdLzOV2FjU= smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCJ5MsbCj0bf6YRmXDhojoClJl5onOClsb6qjRcuCLEl3mJ4YbpxdQT+2uS7UEsFKRlTZQL/U0MlMv77A8MP/g= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_16:23:48 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T16:32:27.957 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T16:32:27.958 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T16:32:27.958 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T16:32:27.960 INFO:teuthology.task.internal:Checking packages... 2024-09-16T16:32:27.981 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T16:32:27.981 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T16:32:27.981 INFO:teuthology.packaging:ref: None 2024-09-16T16:32:27.981 INFO:teuthology.packaging:tag: None 2024-09-16T16:32:27.981 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T16:32:27.981 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:32:27.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T16:32:28.121 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T16:32:28.123 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T16:32:28.129 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T16:32:28.129 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T16:32:28.175 INFO:teuthology.task.internal:Saving configuration 2024-09-16T16:32:28.188 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T16:32:28.194 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T16:32:28.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:47.317809', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+6CltMic5kh/l8tyWpFi6n7MgFl713vNqHaObWLotSOCb3oRLelgI25WTtajIB+0ZRXDzUfEb+ADdLzOV2FjU='} 2024-09-16T16:32:28.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:47.316260', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCJ5MsbCj0bf6YRmXDhojoClJl5onOClsb6qjRcuCLEl3mJ4YbpxdQT+2uS7UEsFKRlTZQL/U0MlMv77A8MP/g='} 2024-09-16T16:32:28.240 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T16:32:28.246 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T16:32:28.246 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T16:32:28.247 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T16:32:28.306 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbed369fbe0>, signals=[15]) 2024-09-16T16:32:28.306 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T16:32:28.312 INFO:teuthology.task.internal:Opening connections... 2024-09-16T16:32:28.312 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T16:32:28.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:28.398 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T16:32:28.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:28.475 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T16:32:28.482 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-09-16T16:32:28.501 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-09-16T16:32:28.501 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-09-16T16:32:28.559 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-09-16T16:32:28.559 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-09-16T16:32:28.559 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-09-16T16:32:28.559 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:28.559 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:28.561 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-09-16T16:32:28.590 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-09-16T16:32:28.607 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-09-16T16:32:28.608 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:28.666 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:28.667 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:28.667 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:28.667 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:28.667 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:28.667 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:28.667 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:28.667 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-09-16T16:32:28.689 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T16:32:28.699 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T16:32:28.705 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T16:32:28.705 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:28.708 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:28.724 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T16:32:28.730 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T16:32:28.731 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:28.765 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:28.791 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T16:32:28.847 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T16:32:28.861 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T16:32:28.861 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T16:32:28.861 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:28.862 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:28.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:28.877 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-16T16:32:28.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:28.878 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-16T16:32:28.934 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:28.935 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-503.el9.x86_64 2024-09-16T16:32:28.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-09-16T16:32:28.936 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:28.936 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.14.0-503.el9.x86_64 2024-09-16T16:32:28.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2024-09-16T16:32:31.216 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-16T16:32:31.362 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-16T16:32:33.267 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-16T16:32:39.534 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-16T16:32:41.092 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-16T16:32:42.446 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-16T16:32:47.944 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-16T16:32:49.950 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:32:49.950 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:32:50.011 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-16T16:32:50.059 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:32:50.064 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:32:50.064 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-16T16:32:50.064 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:32:50.064 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-09-16T16:32:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:32:50.066 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 79 M 2024-09-16T16:32:50.066 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 126 M 2024-09-16T16:32:50.066 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:32:50.470 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 154 kB/s | 23 kB 00:00 2024-09-16T16:32:51.070 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 46 MB/s | 35 MB 00:00 2024-09-16T16:32:51.386 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 31 MB/s | 29 MB 00:00 2024-09-16T16:32:51.720 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T16:32:51.721 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:32:51.721 INFO:teuthology.orchestra.run.smithi104.stdout:Total 48 MB/s | 79 MB 00:01 2024-09-16T16:32:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:32:52.727 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:32:52.727 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:32:53.689 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:32:53.690 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:32:54.462 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-16T16:32:56.137 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:32:56.188 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-16T16:32:56.845 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:32:56.928 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:57.266 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-16T16:32:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:59.838 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:02.898 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T16:33:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:04.805 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:05.113 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:33:05.113 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:33:05.224 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:33:05.234 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:33:05.234 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-09-16T16:33:05.234 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:33:05.234 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:33:05.234 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:Install 4 Packages 2024-09-16T16:33:05.235 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:33:05.236 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 79 M 2024-09-16T16:33:05.236 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 126 M 2024-09-16T16:33:05.236 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:33:05.341 INFO:teuthology.orchestra.run.smithi059.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 276 kB/s | 23 kB 00:00 2024-09-16T16:33:05.699 INFO:teuthology.orchestra.run.smithi059.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-16T16:33:06.100 INFO:teuthology.orchestra.run.smithi059.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-16T16:33:06.517 INFO:teuthology.orchestra.run.smithi059.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-16T16:33:06.517 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:33:06.517 INFO:teuthology.orchestra.run.smithi059.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-16T16:33:07.229 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:33:07.612 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:33:07.612 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:33:08.594 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:33:08.595 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:33:09.638 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:11.180 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:33:11.859 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:11.942 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:14.732 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:14.862 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:19.985 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:20.038 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:25.176 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:47.619 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:47.658 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:48.004 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:48.004 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:48.004 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:48.004 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:33:48.846 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:33:49.246 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:49.326 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:49.326 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:49.327 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:33:49.327 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:33:49.327 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:33:49.327 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T16:33:49.327 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:33:49.327 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:49.385 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:49.386 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:49.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2024-09-16T16:33:49.418 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2024-09-16T16:33:49.418 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2024-09-16T16:33:49.418 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2024-09-16T16:33:49.418 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 82.el9 2024-09-16T16:33:49.418 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2024-09-16T16:33:49.418 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8274670 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2024-09-16T16:33:49.419 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:33:49.420 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:33:49.421 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:33:49.421 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:33:49.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:33:50.084 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-09-16T16:33:51.441 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:33:51.478 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-09-16T16:33:51.480 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-16T16:33:51.495 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.eEXFv24j8F 2024-09-16T16:33:51.495 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eEXFv24j8F 2024-09-16T16:33:51.561 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.eEXFv24j8F 2024-09-16T16:33:51.696 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.eEXFv24j8F is 6KB 2024-09-16T16:33:51.744 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.eEXFv24j8F 2024-09-16T16:33:51.759 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:33:51.822 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:33:51.822 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:33:51.822 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:33:51.822 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:33:51.823 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:33:51.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-09-16T16:34:04.327 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:04.368 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:04.704 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:04.704 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:34:04.704 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:34:04.704 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:34:05.534 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:34:05.535 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:34:05.878 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:06.028 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:06.029 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:06.029 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:34:06.029 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:34:06.029 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:34:06.029 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T16:34:06.029 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:34:06.029 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:06.089 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:06.089 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:06.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2024-09-16T16:34:06.131 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.06 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 82.el9 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Group : Unspecified 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 8274670 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:34:06.132 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : builder@centos.org 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:34:06.133 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:34:06.134 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:34:06.134 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:34:06.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:34:06.741 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-09-16T16:34:08.069 INFO:teuthology.orchestra.run.smithi059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:34:08.113 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-09-16T16:34:08.115 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-16T16:34:08.130 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.B2DtccGuCm 2024-09-16T16:34:08.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B2DtccGuCm 2024-09-16T16:34:08.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.B2DtccGuCm 2024-09-16T16:34:08.342 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.B2DtccGuCm is 6KB 2024-09-16T16:34:08.390 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.B2DtccGuCm 2024-09-16T16:34:08.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:34:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:34:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:34:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:34:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:34:08.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:34:08.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-09-16T16:34:21.993 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T16:34:21.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-16T16:34:21.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:38.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T16:34:38.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-16T16:34:38.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:56.449 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-16T16:35:05.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-16T16:35:05.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:23.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-16T16:35:35.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-16T16:35:35.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:36.223 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-16T16:35:36.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-16T16:35:36.605 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:35:36.608 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-16T16:35:36.623 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:35:36.623 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:35:36.623 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:35:36.623 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:35:37.624 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T16:35:37.624 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:35:37.720 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-09-16T16:35:37.748 DEBUG:teuthology.parallel:result is None 2024-09-16T16:35:38.645 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T16:35:47.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-16T16:35:47.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:48.224 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-16T16:35:48.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-16T16:35:48.660 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:35:48.660 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-16T16:35:48.676 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:35:48.676 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:35:48.676 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:35:48.676 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:35:49.678 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T16:35:49.678 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:35:49.752 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-09-16T16:35:49.782 DEBUG:teuthology.parallel:result is None 2024-09-16T16:35:49.782 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T16:35:49.789 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T16:35:49.790 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:35:49.792 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:35:49.813 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T16:35:49.833 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T16:35:49.843 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T16:35:49.844 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:35:49.852 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:35:49.886 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T16:35:49.893 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T16:35:49.893 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:35:49.923 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:35:49.945 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:49.953 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:49.955 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:49.965 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:49.966 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T16:35:49.974 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T16:35:49.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:35:49.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:35:50.034 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T16:35:50.044 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T16:35:50.044 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:35:50.066 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:35:50.091 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:50.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:50.223 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:50.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:50.349 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:35:50.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:35:50.416 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:50.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:50.514 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:50.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:50.641 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:35:50.641 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:35:50.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-09-16T16:35:50.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-09-16T16:35:50.782 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:35:50.790 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:35:51.232 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T16:35:51.240 INFO:teuthology.task.internal:Starting timer... 2024-09-16T16:35:51.240 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T16:35:51.251 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T16:35:51.308 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T16:35:51.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-09-16T16:35:51.368 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-09-16T16:35:51.371 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-09-16T16:35:51.440 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-09-16T16:35:51.441 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T16:35:51.442 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-09-16T16:35:51.467 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-09-16T16:35:51.468 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-09-16T16:35:51.496 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-09-16T16:35:51.496 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi104.front.sepia.ceph.com': 'permissive'} 2024-09-16T16:35:51.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:35:51.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:35:51.538 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:35:51.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:35:51.565 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T16:35:51.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:35:51.611 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:35:51.651 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T16:35:51.661 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T16:35:51.685 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T16:35:51.686 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi104.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T16:40:17.365 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com')] 2024-09-16T16:40:17.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-16T16:40:17.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:40:17.458 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-16T16:40:17.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-16T16:40:17.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-16T16:40:17.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:40:17.618 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-16T16:40:17.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-16T16:40:17.702 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T16:40:17.713 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T16:40:17.713 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:40:17.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:40:17.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:40:17.716 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:40:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:40:17.760 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:40:17.773 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:40:17.786 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-09-16T16:40:17.787 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:40:17.798 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-09-16T16:40:17.812 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-09-16T16:40:17.813 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:40:17.824 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-09-16T16:40:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:40:17.838 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:40:17.852 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:40:17.889 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:40:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:40:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-16T16:40:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.913 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:40:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:40:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-16T16:40:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:17.916 INFO:teuthology.run_tasks:Running task install... 2024-09-16T16:40:17.925 DEBUG:teuthology.task.install:project ceph 2024-09-16T16:40:17.925 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T16:40:17.925 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T16:40:17.925 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T16:40:17.930 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T16:40:17.930 INFO:teuthology.task.install:extra packages: [] 2024-09-16T16:40:17.931 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:40:17.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:40:17.933 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:40:17.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:40:18.079 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:40:18.080 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:40:18.089 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:40:18.089 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:40:18.359 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:40:18.359 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:40:18.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:40:18.381 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:40:18.382 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:40:18.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:40:18.388 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:40:18.388 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:40:18.409 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:40:18.409 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:40:18.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:40:18.476 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:40:18.538 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:40:18.552 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:40:18.605 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-09-16T16:40:18.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-09-16T16:40:18.616 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-09-16T16:40:18.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-09-16T16:40:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:45 files removed 2024-09-16T16:40:18.850 INFO:teuthology.orchestra.run.smithi059.stdout:45 files removed 2024-09-16T16:40:18.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw 2024-09-16T16:40:18.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw 2024-09-16T16:40:19.947 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 112 kB/s | 88 kB 00:00 2024-09-16T16:40:20.006 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 106 kB/s | 88 kB 00:00 2024-09-16T16:40:20.665 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 36 kB/s | 24 kB 00:00 2024-09-16T16:40:20.731 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 35 kB/s | 24 kB 00:00 2024-09-16T16:40:21.291 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 3.5 kB/s | 2.1 kB 00:00 2024-09-16T16:40:21.373 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 3.4 kB/s | 2.1 kB 00:00 2024-09-16T16:40:22.031 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-16T16:40:22.174 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-16T16:40:24.008 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-16T16:40:24.375 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-16T16:40:29.292 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-16T16:40:30.092 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-16T16:40:30.801 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-16T16:40:31.484 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 108 kB/s | 19 kB 00:00 2024-09-16T16:40:32.072 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-16T16:40:32.488 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-16T16:40:37.794 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T16:40:37.979 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T16:40:40.282 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:40:40.291 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:40:40.291 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:40:40.292 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:40:40.293 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:40:40.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout:Install 31 Packages 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 2 Packages 2024-09-16T16:40:40.295 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:40:40.296 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 60 M 2024-09-16T16:40:40.296 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:40:40.346 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:40:40.363 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:40:40.364 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:40:40.365 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout:Install 31 Packages 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 2 Packages 2024-09-16T16:40:40.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:40:40.367 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 60 M 2024-09-16T16:40:40.367 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:40:43.104 INFO:teuthology.orchestra.run.smithi059.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 2.7 MB/s | 6.1 MB 00:02 2024-09-16T16:40:43.220 INFO:teuthology.orchestra.run.smithi059.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 216 kB/s | 25 kB 00:00 2024-09-16T16:40:43.971 INFO:teuthology.orchestra.run.smithi059.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 1.1 MB/s | 809 kB 00:00 2024-09-16T16:40:44.229 INFO:teuthology.orchestra.run.smithi059.stdout:(4/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 3.1 MB/s | 10 MB 00:03 2024-09-16T16:40:44.338 INFO:teuthology.orchestra.run.smithi059.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 1.5 MB/s | 558 kB 00:00 2024-09-16T16:40:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 416 kB/s | 45 kB 00:00 2024-09-16T16:40:45.038 INFO:teuthology.orchestra.run.smithi059.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 242 kB/s | 143 kB 00:00 2024-09-16T16:40:45.522 INFO:teuthology.orchestra.run.smithi059.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 330 kB/s | 160 kB 00:00 2024-09-16T16:40:45.856 INFO:teuthology.orchestra.run.smithi059.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 945 kB/s | 315 kB 00:00 2024-09-16T16:40:45.947 INFO:teuthology.orchestra.run.smithi059.stdout:(10/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 3.1 MB/s | 5.4 MB 00:01 2024-09-16T16:40:46.214 INFO:teuthology.orchestra.run.smithi059.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 842 kB/s | 302 kB 00:00 2024-09-16T16:40:46.379 INFO:teuthology.orchestra.run.smithi104.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 1.0 MB/s | 6.1 MB 00:05 2024-09-16T16:40:46.462 INFO:teuthology.orchestra.run.smithi104.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 302 kB/s | 25 kB 00:00 2024-09-16T16:40:46.681 INFO:teuthology.orchestra.run.smithi059.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 229 kB/s | 107 kB 00:00 2024-09-16T16:40:46.723 INFO:teuthology.orchestra.run.smithi059.stdout:(13/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 128 kB/s | 99 kB 00:00 2024-09-16T16:40:46.881 INFO:teuthology.orchestra.run.smithi059.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 852 kB/s | 171 kB 00:00 2024-09-16T16:40:46.929 INFO:teuthology.orchestra.run.smithi104.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 1.7 MB/s | 809 kB 00:00 2024-09-16T16:40:46.990 INFO:teuthology.orchestra.run.smithi059.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-09-16T16:40:47.290 INFO:teuthology.orchestra.run.smithi059.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 282 kB/s | 160 kB 00:00 2024-09-16T16:40:47.366 INFO:teuthology.orchestra.run.smithi059.stdout:(17/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-16T16:40:47.482 INFO:teuthology.orchestra.run.smithi059.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 363 kB/s | 42 kB 00:00 2024-09-16T16:40:47.508 INFO:teuthology.orchestra.run.smithi059.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-09-16T16:40:47.600 INFO:teuthology.orchestra.run.smithi059.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-16T16:40:47.613 INFO:teuthology.orchestra.run.smithi104.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 817 kB/s | 558 kB 00:00 2024-09-16T16:40:47.625 INFO:teuthology.orchestra.run.smithi059.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 307 kB/s | 36 kB 00:00 2024-09-16T16:40:47.684 INFO:teuthology.orchestra.run.smithi059.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 5.2 MB/s | 308 kB 00:00 2024-09-16T16:40:47.709 INFO:teuthology.orchestra.run.smithi059.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-16T16:40:47.759 INFO:teuthology.orchestra.run.smithi059.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-16T16:40:47.793 INFO:teuthology.orchestra.run.smithi059.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-16T16:40:47.826 INFO:teuthology.orchestra.run.smithi059.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-16T16:40:47.910 INFO:teuthology.orchestra.run.smithi059.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-16T16:40:47.943 INFO:teuthology.orchestra.run.smithi059.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T16:40:48.035 INFO:teuthology.orchestra.run.smithi059.stdout:(29/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-16T16:40:48.094 INFO:teuthology.orchestra.run.smithi059.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-16T16:40:48.729 INFO:teuthology.orchestra.run.smithi104.stdout:(5/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 2.4 MB/s | 20 MB 00:08 2024-09-16T16:40:48.821 INFO:teuthology.orchestra.run.smithi104.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 495 kB/s | 45 kB 00:00 2024-09-16T16:40:48.930 INFO:teuthology.orchestra.run.smithi104.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.3 MB/s | 143 kB 00:00 2024-09-16T16:40:49.022 INFO:teuthology.orchestra.run.smithi104.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.7 MB/s | 160 kB 00:00 2024-09-16T16:40:49.189 INFO:teuthology.orchestra.run.smithi104.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 1.8 MB/s | 315 kB 00:00 2024-09-16T16:40:49.356 INFO:teuthology.orchestra.run.smithi104.stdout:(10/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 1.8 MB/s | 302 kB 00:00 2024-09-16T16:40:49.448 INFO:teuthology.orchestra.run.smithi104.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.1 MB/s | 99 kB 00:00 2024-09-16T16:40:49.906 INFO:teuthology.orchestra.run.smithi104.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 233 kB/s | 107 kB 00:00 2024-09-16T16:40:50.019 INFO:teuthology.orchestra.run.smithi059.stdout:(31/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 2.0 MB/s | 3.8 MB 00:01 2024-09-16T16:40:50.106 INFO:teuthology.orchestra.run.smithi104.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 854 kB/s | 171 kB 00:00 2024-09-16T16:40:50.223 INFO:teuthology.orchestra.run.smithi104.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-16T16:40:50.331 INFO:teuthology.orchestra.run.smithi104.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-09-16T16:40:50.623 INFO:teuthology.orchestra.run.smithi104.stdout:(16/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-16T16:40:50.741 INFO:teuthology.orchestra.run.smithi104.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-09-16T16:40:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 390 kB/s | 42 kB 00:00 2024-09-16T16:40:51.000 INFO:teuthology.orchestra.run.smithi104.stdout:(19/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 1.6 MB/s | 5.4 MB 00:03 2024-09-16T16:40:51.025 INFO:teuthology.orchestra.run.smithi104.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-09-16T16:40:51.133 INFO:teuthology.orchestra.run.smithi104.stdout:(21/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-16T16:40:51.192 INFO:teuthology.orchestra.run.smithi104.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 5.2 MB/s | 308 kB 00:00 2024-09-16T16:40:51.292 INFO:teuthology.orchestra.run.smithi104.stdout:(23/33): qatlib-service-24.02.0-1.el9.x86_64.rp 123 kB/s | 36 kB 00:00 2024-09-16T16:40:51.376 INFO:teuthology.orchestra.run.smithi104.stdout:(24/33): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-16T16:40:51.401 INFO:teuthology.orchestra.run.smithi104.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-16T16:40:51.427 INFO:teuthology.orchestra.run.smithi104.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 194 kB/s | 26 kB 00:00 2024-09-16T16:40:51.451 INFO:teuthology.orchestra.run.smithi104.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T16:40:51.502 INFO:teuthology.orchestra.run.smithi104.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T16:40:51.577 INFO:teuthology.orchestra.run.smithi104.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-09-16T16:40:51.619 INFO:teuthology.orchestra.run.smithi104.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-16T16:40:51.669 INFO:teuthology.orchestra.run.smithi059.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 977 kB/s | 3.5 MB 00:03 2024-09-16T16:40:52.911 INFO:teuthology.orchestra.run.smithi104.stdout:(31/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 2.9 MB/s | 3.8 MB 00:01 2024-09-16T16:40:53.561 INFO:teuthology.orchestra.run.smithi104.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 1.7 MB/s | 3.5 MB 00:01 2024-09-16T16:40:54.102 INFO:teuthology.orchestra.run.smithi059.stdout:(33/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 1.5 MB/s | 20 MB 00:13 2024-09-16T16:40:54.108 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:40:54.109 INFO:teuthology.orchestra.run.smithi059.stdout:Total 4.4 MB/s | 60 MB 00:13 2024-09-16T16:40:54.231 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:40:54.274 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:40:54.274 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:40:54.994 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:40:54.994 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:40:55.811 INFO:teuthology.orchestra.run.smithi104.stdout:(33/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9 691 kB/s | 10 MB 00:15 2024-09-16T16:40:55.817 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:40:55.817 INFO:teuthology.orchestra.run.smithi104.stdout:Total 3.9 MB/s | 60 MB 00:15 2024-09-16T16:40:55.935 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:40:55.972 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:40:55.973 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:40:56.538 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:40:56.640 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:40:56.640 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:40:57.078 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:40:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:57.239 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:57.336 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:57.364 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:57.419 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:57.473 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:40:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:40:57.528 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:40:57.550 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:57.574 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:57.771 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:57.800 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:57.836 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:40:57.880 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:40:57.908 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:58.008 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:40:58.055 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:58.153 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:40:58.162 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:40:58.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:40:58.305 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:40:58.356 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:40:58.386 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:40:58.416 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:40:58.453 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:40:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:40:58.746 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:40:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:40:58.927 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:58.964 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:58.987 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:40:59.025 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:40:59.027 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:59.061 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:40:59.081 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:40:59.110 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:40:59.136 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:40:59.158 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:59.181 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:59.535 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:59.567 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:59.602 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:40:59.645 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:40:59.674 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:40:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:59.705 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:40:59.765 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:40:59.769 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:40:59.796 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:59.850 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:40:59.884 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:59.891 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:40:59.920 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:41:00.032 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:41:00.066 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:41:00.114 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:41:00.145 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:41:00.174 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:41:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:41:00.578 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:41:00.636 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:41:00.727 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:41:00.766 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:41:00.810 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:41:01.390 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:41:01.422 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:41:01.493 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:41:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:41:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:41:02.505 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:02.612 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:03.369 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:03.407 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:41:03.498 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:41:03.499 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:41:03.499 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:41:03.499 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:04.229 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:04.957 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:05.006 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:41:05.095 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:41:05.095 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:41:05.095 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:41:05.095 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:05.132 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:14.072 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-09-16T16:41:14.073 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:15.118 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-09-16T16:41:15.119 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:15.214 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:41:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:41:15.241 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:41:15.241 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:41:15.241 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:41:15.241 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:41:15.241 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:15.243 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:41:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:41:15.333 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:16.214 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:41:16.240 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:41:16.240 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:41:16.240 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:41:16.240 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:41:16.240 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:41:16.240 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:16.242 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:41:16.325 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:41:16.325 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:41:16.658 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:41:16.659 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:41:16.660 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:41:17.658 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:17.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:41:17.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:17.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:41:17.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:17.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:41:17.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:41:17.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:41:17.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:41:17.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:41:17.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:41:17.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:41:17.661 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:17.662 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:41:17.662 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:41:17.774 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:41:17.775 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:17.777 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:41:18.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-test 2024-09-16T16:41:18.698 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:18.698 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:18.698 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-09-16T16:41:18.698 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.698 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.699 INFO:teuthology.orchestra.run.smithi104.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.700 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:18.701 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:41:18.702 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:41 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:41:18.848 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:41:18.849 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:41:18.849 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:41:18.849 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:41:18.849 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:41:18.849 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:41:18.849 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout:Install 9 Packages 2024-09-16T16:41:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:41:18.851 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 87 M 2024-09-16T16:41:18.851 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 797 M 2024-09-16T16:41:18.851 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:41:19.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-test 2024-09-16T16:41:19.609 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:42 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:41:19.748 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:41:19.748 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:41:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout:Install 9 Packages 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 87 M 2024-09-16T16:41:19.750 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 797 M 2024-09-16T16:41:19.751 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:41:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 197 kB/s | 94 kB 00:00 2024-09-16T16:41:19.988 INFO:teuthology.orchestra.run.smithi059.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.3 MB/s | 513 kB 00:00 2024-09-16T16:41:20.029 INFO:teuthology.orchestra.run.smithi059.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-16T16:41:20.221 INFO:teuthology.orchestra.run.smithi059.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-16T16:41:20.255 INFO:teuthology.orchestra.run.smithi059.stdout:(5/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 195 kB/s | 175 kB 00:00 2024-09-16T16:41:20.339 INFO:teuthology.orchestra.run.smithi059.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-16T16:41:20.364 INFO:teuthology.orchestra.run.smithi059.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 587 kB/s | 64 kB 00:00 2024-09-16T16:41:20.379 INFO:teuthology.orchestra.run.smithi104.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 711 kB/s | 94 kB 00:00 2024-09-16T16:41:20.439 INFO:teuthology.orchestra.run.smithi059.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.2 MB/s | 122 kB 00:00 2024-09-16T16:41:20.538 INFO:teuthology.orchestra.run.smithi104.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.2 MB/s | 513 kB 00:00 2024-09-16T16:41:20.580 INFO:teuthology.orchestra.run.smithi104.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-16T16:41:20.647 INFO:teuthology.orchestra.run.smithi104.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-16T16:41:20.689 INFO:teuthology.orchestra.run.smithi104.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-16T16:41:20.731 INFO:teuthology.orchestra.run.smithi104.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-16T16:41:20.798 INFO:teuthology.orchestra.run.smithi104.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-16T16:41:21.131 INFO:teuthology.orchestra.run.smithi104.stdout:(8/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 198 kB/s | 175 kB 00:00 2024-09-16T16:43:02.972 INFO:teuthology.orchestra.run.smithi059.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 837 kB/s | 85 MB 01:43 2024-09-16T16:43:02.973 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:02.973 INFO:teuthology.orchestra.run.smithi059.stdout:Total 856 kB/s | 87 MB 01:44 2024-09-16T16:43:03.045 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:43:03.070 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:43:03.070 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:43:03.722 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:43:03.723 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:43:04.647 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:43:04.725 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:43:04.774 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:43:04.817 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:43:04.860 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:43:04.891 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:04.916 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:04.990 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:05.034 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:43:05.067 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:16.960 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:17.051 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:43:23.030 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:43:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:43:23.487 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:43:23.487 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:43:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:43:23.487 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:23.487 INFO:teuthology.orchestra.run.smithi059.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:43:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:43:23.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph 2024-09-16T16:43:24.443 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:02:47 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:43:24.594 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:43:24.597 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:43:24.597 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:43:24.597 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:43:24.597 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:43:24.598 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:43:24.599 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:43:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout:Install 37 Packages 2024-09-16T16:43:24.601 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:43:24.602 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 84 M 2024-09-16T16:43:24.602 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 897 M 2024-09-16T16:43:24.602 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:43:25.686 INFO:teuthology.orchestra.run.smithi059.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2024-09-16T16:43:28.478 INFO:teuthology.orchestra.run.smithi059.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 520 kB/s | 1.6 MB 00:03 2024-09-16T16:43:29.386 INFO:teuthology.orchestra.run.smithi059.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 556 kB/s | 2.2 MB 00:04 2024-09-16T16:43:29.962 INFO:teuthology.orchestra.run.smithi059.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 506 kB/s | 291 kB 00:00 2024-09-16T16:43:30.087 INFO:teuthology.orchestra.run.smithi059.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-16T16:43:30.179 INFO:teuthology.orchestra.run.smithi059.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-16T16:43:30.221 INFO:teuthology.orchestra.run.smithi059.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T16:43:30.263 INFO:teuthology.orchestra.run.smithi059.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-16T16:43:30.305 INFO:teuthology.orchestra.run.smithi059.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-16T16:43:30.347 INFO:teuthology.orchestra.run.smithi059.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-09-16T16:43:30.522 INFO:teuthology.orchestra.run.smithi059.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-16T16:43:30.581 INFO:teuthology.orchestra.run.smithi059.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-16T16:43:30.631 INFO:teuthology.orchestra.run.smithi059.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 694 kB/s | 35 kB 00:00 2024-09-16T16:43:30.681 INFO:teuthology.orchestra.run.smithi059.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T16:43:30.732 INFO:teuthology.orchestra.run.smithi059.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T16:43:30.798 INFO:teuthology.orchestra.run.smithi059.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 628 kB/s | 42 kB 00:00 2024-09-16T16:43:30.923 INFO:teuthology.orchestra.run.smithi059.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-16T16:43:30.982 INFO:teuthology.orchestra.run.smithi059.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-16T16:43:31.007 INFO:teuthology.orchestra.run.smithi059.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T16:43:31.049 INFO:teuthology.orchestra.run.smithi059.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-16T16:43:31.125 INFO:teuthology.orchestra.run.smithi059.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-09-16T16:43:31.150 INFO:teuthology.orchestra.run.smithi059.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-16T16:43:31.175 INFO:teuthology.orchestra.run.smithi059.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 712 kB/s | 18 kB 00:00 2024-09-16T16:43:31.200 INFO:teuthology.orchestra.run.smithi059.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 931 kB/s | 23 kB 00:00 2024-09-16T16:43:31.225 INFO:teuthology.orchestra.run.smithi059.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 779 kB/s | 19 kB 00:00 2024-09-16T16:43:31.251 INFO:teuthology.orchestra.run.smithi059.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 785 kB/s | 20 kB 00:00 2024-09-16T16:43:31.276 INFO:teuthology.orchestra.run.smithi059.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-16T16:43:31.310 INFO:teuthology.orchestra.run.smithi059.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 2.3 MB/s | 79 kB 00:00 2024-09-16T16:43:31.360 INFO:teuthology.orchestra.run.smithi059.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-16T16:43:31.385 INFO:teuthology.orchestra.run.smithi059.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 658 kB/s | 16 kB 00:00 2024-09-16T16:43:31.419 INFO:teuthology.orchestra.run.smithi059.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-09-16T16:43:31.444 INFO:teuthology.orchestra.run.smithi059.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T16:43:31.478 INFO:teuthology.orchestra.run.smithi059.stdout:(33/37): python3-webob-1.8.8-2.el9.noarch.rpm 6.8 MB/s | 230 kB 00:00 2024-09-16T16:43:31.520 INFO:teuthology.orchestra.run.smithi059.stdout:(34/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2024-09-16T16:43:31.537 INFO:teuthology.orchestra.run.smithi059.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-16T16:43:37.045 INFO:teuthology.orchestra.run.smithi059.stdout:(36/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 460 kB/s | 5.1 MB 00:11 2024-09-16T16:44:03.233 INFO:teuthology.orchestra.run.smithi104.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 532 kB/s | 85 MB 02:42 2024-09-16T16:44:03.236 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:03.236 INFO:teuthology.orchestra.run.smithi104.stdout:Total 545 kB/s | 87 MB 02:43 2024-09-16T16:44:03.306 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:44:03.327 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:44:03.327 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:44:03.942 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:44:03.942 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:44:04.829 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:44:04.910 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:44:04.968 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:44:05.012 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:44:05.047 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:44:05.079 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:05.103 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:44:05.182 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:44:05.229 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:44:05.276 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:44:12.965 INFO:teuthology.orchestra.run.smithi059.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 1.6 MB/s | 70 MB 00:44 2024-09-16T16:44:12.969 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:12.969 INFO:teuthology.orchestra.run.smithi059.stdout:Total 1.7 MB/s | 84 MB 00:48 2024-09-16T16:44:13.126 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:44:13.171 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:44:13.171 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:44:13.987 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:44:13.988 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:44:15.677 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:44:15.743 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:44:15.776 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:44:15.803 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:44:15.880 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:44:15.928 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:44:15.961 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:44:16.057 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:44:16.134 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:44:16.181 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:44:16.215 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:44:16.252 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:44:16.295 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:44:16.329 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:44:16.370 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:44:16.413 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:44:16.436 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:44:16.447 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:44:16.496 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:44:16.514 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:16.536 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:44:16.612 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:44:16.764 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:44:16.847 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:44:16.898 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:44:16.935 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:44:16.994 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:44:17.058 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:44:17.261 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:44:17.306 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:44:17.387 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:44:17.476 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:44:17.526 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:44:17.665 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:44:17.868 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:44:17.897 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:17.925 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:17.926 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:17.926 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:44:17.926 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:17.926 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:17.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:22.453 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:22.453 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:44:22.453 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:44:22.454 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:44:22.454 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:44:22.454 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:22.454 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:44:22.454 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:44:22.454 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:44:22.891 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:44:22.892 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:44:22.892 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:44:22.892 INFO:teuthology.orchestra.run.smithi104.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:44:22.892 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:44:22.892 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:44:23.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph 2024-09-16T16:44:23.773 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:03:46 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:23.907 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:44:23.909 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:44:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:44:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:44:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout:Install 37 Packages 2024-09-16T16:44:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:44:23.914 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 84 M 2024-09-16T16:44:23.914 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 897 M 2024-09-16T16:44:23.914 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:44:24.881 INFO:teuthology.orchestra.run.smithi104.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 21 kB/s | 6.5 kB 00:00 2024-09-16T16:44:25.873 INFO:teuthology.orchestra.run.smithi104.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.2 MB/s | 1.6 MB 00:01 2024-09-16T16:44:26.098 INFO:teuthology.orchestra.run.smithi104.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.4 MB/s | 2.2 MB 00:01 2024-09-16T16:44:26.365 INFO:teuthology.orchestra.run.smithi104.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.1 MB/s | 291 kB 00:00 2024-09-16T16:44:26.924 INFO:teuthology.orchestra.run.smithi104.stdout:(5/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 2.5 MB/s | 5.1 MB 00:02 2024-09-16T16:44:27.390 INFO:teuthology.orchestra.run.smithi104.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 247 kB/s | 253 kB 00:01 2024-09-16T16:44:28.074 INFO:teuthology.orchestra.run.smithi104.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-09-16T16:44:28.783 INFO:teuthology.orchestra.run.smithi104.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 191 kB/s | 135 kB 00:00 2024-09-16T16:44:29.133 INFO:teuthology.orchestra.run.smithi104.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 568 kB/s | 1.2 MB 00:02 2024-09-16T16:44:29.189 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:29.218 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:44:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:29.218 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:29.533 INFO:teuthology.orchestra.run.smithi104.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 166 kB/s | 125 kB 00:00 2024-09-16T16:44:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-16T16:44:29.784 INFO:teuthology.orchestra.run.smithi104.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-16T16:44:29.790 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:29.815 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:29.815 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:29.816 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:44:29.816 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:29.816 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:29.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:29.836 INFO:teuthology.orchestra.run.smithi104.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 698 kB/s | 35 kB 00:00 2024-09-16T16:44:29.884 INFO:teuthology.orchestra.run.smithi104.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T16:44:29.942 INFO:teuthology.orchestra.run.smithi104.stdout:(15/37): python3-urllib3-1.26.5-6.el9.noarch.rp 266 kB/s | 215 kB 00:00 2024-09-16T16:44:29.967 INFO:teuthology.orchestra.run.smithi104.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 616 kB/s | 51 kB 00:00 2024-09-16T16:44:30.051 INFO:teuthology.orchestra.run.smithi104.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-09-16T16:44:30.074 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:30.099 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:30.100 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:30.100 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:44:30.100 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:30.100 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:30.100 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:30.118 INFO:teuthology.orchestra.run.smithi104.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-16T16:44:30.143 INFO:teuthology.orchestra.run.smithi104.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T16:44:30.168 INFO:teuthology.orchestra.run.smithi104.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-16T16:44:30.175 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:44:30.202 INFO:teuthology.orchestra.run.smithi104.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-16T16:44:30.227 INFO:teuthology.orchestra.run.smithi104.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-16T16:44:30.252 INFO:teuthology.orchestra.run.smithi104.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 712 kB/s | 18 kB 00:00 2024-09-16T16:44:30.278 INFO:teuthology.orchestra.run.smithi104.stdout:(24/37): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-16T16:44:30.303 INFO:teuthology.orchestra.run.smithi104.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-16T16:44:30.337 INFO:teuthology.orchestra.run.smithi104.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 768 kB/s | 20 kB 00:00 2024-09-16T16:44:30.362 INFO:teuthology.orchestra.run.smithi104.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 2.0 MB/s | 46 kB 00:00 2024-09-16T16:44:30.387 INFO:teuthology.orchestra.run.smithi104.stdout:(28/37): python3-jaraco-functools-3.5.0-2.el9.n 178 kB/s | 19 kB 00:00 2024-09-16T16:44:30.412 INFO:teuthology.orchestra.run.smithi104.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T16:44:30.438 INFO:teuthology.orchestra.run.smithi104.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 654 kB/s | 16 kB 00:00 2024-09-16T16:44:30.463 INFO:teuthology.orchestra.run.smithi104.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T16:44:30.488 INFO:teuthology.orchestra.run.smithi104.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T16:44:30.514 INFO:teuthology.orchestra.run.smithi104.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-16T16:44:30.539 INFO:teuthology.orchestra.run.smithi104.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T16:44:30.564 INFO:teuthology.orchestra.run.smithi104.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-16T16:44:30.589 INFO:teuthology.orchestra.run.smithi104.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T16:44:36.633 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:44:36.633 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:44:36.633 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:44:36.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:44:36.635 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:44:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:44:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:44:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:37.892 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:44:38.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-base 2024-09-16T16:44:38.739 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:01 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:38.834 INFO:teuthology.orchestra.run.smithi059.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:38.879 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:44:38.880 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:44:38.880 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:44:38.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install cephadm 2024-09-16T16:44:39.542 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:02 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:39.679 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:44:39.680 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:39.681 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:44:39.681 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:39.681 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 785 k 2024-09-16T16:44:39.681 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 791 k 2024-09-16T16:44:39.681 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:44:40.665 INFO:teuthology.orchestra.run.smithi059.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 798 kB/s | 785 kB 00:00 2024-09-16T16:44:40.666 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:40.666 INFO:teuthology.orchestra.run.smithi059.stdout:Total 797 kB/s | 785 kB 00:00 2024-09-16T16:44:40.666 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:44:40.672 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:44:40.672 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:44:40.679 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:44:40.679 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:44:40.753 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:44:41.241 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:41.338 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:41.707 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:41.951 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:41.951 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:44:41.951 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:41.951 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:41.951 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:44:42.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:44:42.766 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:05 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:42.906 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:44:42.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:42.908 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 158 k 2024-09-16T16:44:42.908 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 644 k 2024-09-16T16:44:42.908 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:44:43.745 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 189 kB/s | 158 kB 00:00 2024-09-16T16:44:43.746 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:43.746 INFO:teuthology.orchestra.run.smithi059.stdout:Total 188 kB/s | 158 kB 00:00 2024-09-16T16:44:43.746 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:44:43.758 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:44:43.758 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:44:43.823 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:44:43.823 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:44:43.988 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:44:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:44.097 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:44.097 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:44:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:45.148 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:45.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:45.149 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:44:45.149 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:45.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:45.149 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:44:45.364 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr 2024-09-16T16:44:45.956 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:08 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:46.052 INFO:teuthology.orchestra.run.smithi059.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:46.097 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:44:46.098 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:44:46.098 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:44:46.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:44:46.758 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:09 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:46.899 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:44:46.900 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:44:46.901 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout:Install 11 Packages 2024-09-16T16:44:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:46.903 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 18 M 2024-09-16T16:44:46.903 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 155 M 2024-09-16T16:44:46.903 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:44:47.840 INFO:teuthology.orchestra.run.smithi059.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 41 kB/s | 16 kB 00:00 2024-09-16T16:44:47.865 INFO:teuthology.orchestra.run.smithi059.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 80 kB/s | 34 kB 00:00 2024-09-16T16:44:48.123 INFO:teuthology.orchestra.run.smithi059.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 950 kB/s | 269 kB 00:00 2024-09-16T16:44:48.198 INFO:teuthology.orchestra.run.smithi059.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 7.2 MB/s | 548 kB 00:00 2024-09-16T16:44:48.224 INFO:teuthology.orchestra.run.smithi059.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-16T16:44:48.307 INFO:teuthology.orchestra.run.smithi059.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 24 MB/s | 2.0 MB 00:00 2024-09-16T16:44:48.333 INFO:teuthology.orchestra.run.smithi059.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-16T16:44:48.358 INFO:teuthology.orchestra.run.smithi059.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T16:44:48.392 INFO:teuthology.orchestra.run.smithi059.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-16T16:44:48.709 INFO:teuthology.orchestra.run.smithi059.stdout:(10/11): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-16T16:44:50.167 INFO:teuthology.orchestra.run.smithi059.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 5.2 MB/s | 14 MB 00:02 2024-09-16T16:44:50.171 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:50.171 INFO:teuthology.orchestra.run.smithi059.stdout:Total 5.6 MB/s | 18 MB 00:03 2024-09-16T16:44:50.206 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:44:50.229 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:44:50.229 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:44:50.506 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:44:50.506 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:44:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:44:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:44:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:44:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:44:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:44:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:44:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:44:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:44:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:44:55.133 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:44:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:56.360 INFO:teuthology.orchestra.run.smithi104.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.3 MB/s | 70 MB 00:30 2024-09-16T16:44:56.365 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:56.365 INFO:teuthology.orchestra.run.smithi104.stdout:Total 2.6 MB/s | 84 MB 00:32 2024-09-16T16:44:56.510 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:44:56.553 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:44:56.553 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:44:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:44:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:44:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:44:57.087 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:44:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:44:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:44:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:44:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:44:57.088 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:44:57.349 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:44:57.349 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:44:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:44:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:44:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:44:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:57.449 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:44:57.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:44:58.282 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:21 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:44:58.424 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:44:58.424 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:44:58.425 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout:Install 12 Packages 2024-09-16T16:44:58.426 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:44:58.427 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 38 M 2024-09-16T16:44:58.427 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 212 M 2024-09-16T16:44:58.427 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:44:58.723 INFO:teuthology.orchestra.run.smithi059.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-16T16:44:58.756 INFO:teuthology.orchestra.run.smithi059.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 5.0 MB/s | 801 kB 00:00 2024-09-16T16:44:58.840 INFO:teuthology.orchestra.run.smithi059.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-16T16:44:58.890 INFO:teuthology.orchestra.run.smithi059.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-16T16:44:58.941 INFO:teuthology.orchestra.run.smithi059.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 762 kB/s | 38 kB 00:00 2024-09-16T16:44:59.017 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:44:59.079 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:44:59.083 INFO:teuthology.orchestra.run.smithi059.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.2 MB/s | 3.0 MB 00:00 2024-09-16T16:44:59.112 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:44:59.141 INFO:teuthology.orchestra.run.smithi059.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-16T16:44:59.148 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:44:59.220 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:44:59.250 INFO:teuthology.orchestra.run.smithi059.stdout:(8/12): ceph-mgr-diskprediction-local-19.3.0-48 11 MB/s | 7.4 MB 00:00 2024-09-16T16:44:59.263 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:44:59.304 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:44:59.325 INFO:teuthology.orchestra.run.smithi059.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-16T16:44:59.396 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:44:59.442 INFO:teuthology.orchestra.run.smithi059.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-16T16:44:59.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:44:59.516 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:44:59.550 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:44:59.551 INFO:teuthology.orchestra.run.smithi059.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 834 kB/s | 250 kB 00:00 2024-09-16T16:44:59.580 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:44:59.615 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:44:59.648 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:44:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:44:59.740 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:44:59.783 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:44:59.826 INFO:teuthology.orchestra.run.smithi059.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-16T16:44:59.827 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:59.827 INFO:teuthology.orchestra.run.smithi059.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-16T16:44:59.831 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:44:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:44:59.937 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:45:00.076 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:45:00.155 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:45:00.192 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:45:00.219 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:00.219 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:45:00.312 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:45:00.367 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:45:00.563 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:45:00.617 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:45:00.697 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:00.697 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:00.703 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:45:00.799 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:45:00.849 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:45:00.978 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:45:01.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:45:01.201 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:45:01.227 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:45:01.227 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:01.227 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:45:01.228 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:45:01.228 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:45:01.228 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:01.484 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:01.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:01.696 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:01.734 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:01.928 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:01.974 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:02.072 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:02.780 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:02.900 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:04.228 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:05.313 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:05.339 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:07.991 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:07.992 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:07.993 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:08.490 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:08.491 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:08.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:09.437 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:32 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:09.578 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:45:09.579 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:09.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout:Install 13 Packages 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 2.2 M 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 26 M 2024-09-16T16:45:09.581 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:09.904 INFO:teuthology.orchestra.run.smithi059.stdout:(1/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 296 kB/s | 49 kB 00:00 2024-09-16T16:45:10.280 INFO:teuthology.orchestra.run.smithi059.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 35 kB/s | 19 kB 00:00 2024-09-16T16:45:10.305 INFO:teuthology.orchestra.run.smithi059.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-16T16:45:10.663 INFO:teuthology.orchestra.run.smithi059.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 293 kB/s | 222 kB 00:00 2024-09-16T16:45:11.005 INFO:teuthology.orchestra.run.smithi059.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-09-16T16:45:11.064 INFO:teuthology.orchestra.run.smithi059.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 558 kB/s | 32 kB 00:00 2024-09-16T16:45:11.089 INFO:teuthology.orchestra.run.smithi059.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 566 kB/s | 14 kB 00:00 2024-09-16T16:45:11.131 INFO:teuthology.orchestra.run.smithi059.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 5.2 MB/s | 220 kB 00:00 2024-09-16T16:45:11.165 INFO:teuthology.orchestra.run.smithi059.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 324 kB/s | 279 kB 00:00 2024-09-16T16:45:11.207 INFO:teuthology.orchestra.run.smithi059.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-16T16:45:11.241 INFO:teuthology.orchestra.run.smithi059.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-16T16:45:11.283 INFO:teuthology.orchestra.run.smithi059.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-16T16:45:11.316 INFO:teuthology.orchestra.run.smithi059.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 82 kB/s | 54 kB 00:00 2024-09-16T16:45:11.319 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:11.320 INFO:teuthology.orchestra.run.smithi059.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-09-16T16:45:11.390 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:11.406 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:11.407 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:11.506 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:11.506 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:11.775 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:11.802 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:11.803 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:11.803 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:45:11.803 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:11.803 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:11.803 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:12.060 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:12.343 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:12.367 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:12.367 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:12.367 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:45:12.367 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:12.367 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:12.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:12.461 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:12.577 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:12.602 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:12.625 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:12.625 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:12.625 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:45:12.625 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:12.625 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:12.626 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:12.695 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:12.755 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:13.531 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:13.575 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:13.609 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:13.658 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:13.686 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:14.520 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:14.520 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:14.520 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:14.520 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:14.521 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:14.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:14.856 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:15.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:15.715 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:38 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:15.854 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:15.854 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:15.854 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:15.855 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:15.856 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:15.856 INFO:teuthology.orchestra.run.smithi059.stdout:Install 6 Packages 2024-09-16T16:45:15.856 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:15.856 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 7.0 M 2024-09-16T16:45:15.856 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 33 M 2024-09-16T16:45:15.856 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:16.659 INFO:teuthology.orchestra.run.smithi059.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-16T16:45:16.751 INFO:teuthology.orchestra.run.smithi059.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.9 MB/s | 548 kB 00:00 2024-09-16T16:45:16.776 INFO:teuthology.orchestra.run.smithi059.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T16:45:16.801 INFO:teuthology.orchestra.run.smithi059.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T16:45:16.885 INFO:teuthology.orchestra.run.smithi059.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-16T16:45:17.010 INFO:teuthology.orchestra.run.smithi059.stdout:(6/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 316 kB/s | 154 kB 00:00 2024-09-16T16:45:17.012 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:17.012 INFO:teuthology.orchestra.run.smithi059.stdout:Total 6.1 MB/s | 7.0 MB 00:01 2024-09-16T16:45:17.088 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:17.208 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:17.208 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:17.532 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:17.701 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:17.755 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:18.310 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:18.401 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:18.486 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:18.515 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:45:19.052 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:45:19.053 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:45:19.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:45:19.055 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:45:19.055 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:45:19.055 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:45:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:45:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:45:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:45:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:45:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:45:19.056 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:45:19.249 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:19.249 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:19.249 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:19.249 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:19.249 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:19.249 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:19.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:19.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:19.547 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:19.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-fuse 2024-09-16T16:45:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:45:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:45:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:45:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:45:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:45:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:45:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:45:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:20.144 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:20.409 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-base 2024-09-16T16:45:20.412 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:43 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:20.552 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout:Install 2 Packages 2024-09-16T16:45:20.553 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:20.554 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 964 k 2024-09-16T16:45:20.554 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 4.1 M 2024-09-16T16:45:20.554 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:20.944 INFO:teuthology.orchestra.run.smithi059.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 712 kB/s | 80 kB 00:00 2024-09-16T16:45:20.970 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:04:43 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:21.060 INFO:teuthology.orchestra.run.smithi104.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:21.101 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:21.103 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:45:21.103 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:21.171 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install cephadm 2024-09-16T16:45:21.620 INFO:teuthology.orchestra.run.smithi059.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 1.1 MB/s | 884 kB 00:00 2024-09-16T16:45:21.620 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:21.621 INFO:teuthology.orchestra.run.smithi059.stdout:Total 903 kB/s | 964 kB 00:01 2024-09-16T16:45:21.635 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:21.663 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:21.663 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:21.728 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:04:44 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:21.754 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:21.754 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:21.859 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:21.860 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 785 k 2024-09-16T16:45:21.861 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 791 k 2024-09-16T16:45:21.861 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:22.110 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:22.603 INFO:teuthology.orchestra.run.smithi104.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.0 MB/s | 785 kB 00:00 2024-09-16T16:45:22.603 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:22.604 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.0 MB/s | 785 kB 00:00 2024-09-16T16:45:22.604 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:22.610 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:22.610 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:22.616 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:22.616 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:22.687 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:22.837 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:22.837 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:23.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:23.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:23.137 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:23.137 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:23.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:23.138 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:23.152 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:23.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-volume 2024-09-16T16:45:23.616 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:23.886 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:23.886 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:24.030 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:47 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:24.107 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:45:24.170 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:24.170 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:45:24.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:24.172 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 285 k 2024-09-16T16:45:24.172 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 1.3 M 2024-09-16T16:45:24.172 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:24.639 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 610 kB/s | 285 kB 00:00 2024-09-16T16:45:24.640 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:24.640 INFO:teuthology.orchestra.run.smithi059.stdout:Total 608 kB/s | 285 kB 00:00 2024-09-16T16:45:24.640 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:24.650 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:24.650 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:24.680 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:04:47 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:24.685 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:24.685 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:45:24.815 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:24.816 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:24.816 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:24.816 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:45:24.816 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:24.816 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 158 k 2024-09-16T16:45:24.816 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 644 k 2024-09-16T16:45:24.817 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:24.921 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:25.000 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:25.017 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:25.017 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:25.017 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:45:25.017 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:25.225 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 387 kB/s | 158 kB 00:00 2024-09-16T16:45:25.226 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:25.226 INFO:teuthology.orchestra.run.smithi104.stdout:Total 385 kB/s | 158 kB 00:00 2024-09-16T16:45:25.226 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:25.236 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:25.236 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:25.293 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:25.293 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:25.441 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:25.534 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:25.534 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:45:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:26.069 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:26.069 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:26.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install librados-devel 2024-09-16T16:45:26.543 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:26.544 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:26.544 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:26.544 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:26.544 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:26.544 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:26.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr 2024-09-16T16:45:26.966 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:49 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:27.104 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:27.104 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:45:27.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:27.106 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 125 k 2024-09-16T16:45:27.106 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 445 k 2024-09-16T16:45:27.106 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:27.330 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:04:50 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:27.424 INFO:teuthology.orchestra.run.smithi104.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:27.444 INFO:teuthology.orchestra.run.smithi059.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 369 kB/s | 125 kB 00:00 2024-09-16T16:45:27.445 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:27.445 INFO:teuthology.orchestra.run.smithi059.stdout:Total 367 kB/s | 125 kB 00:00 2024-09-16T16:45:27.445 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:27.451 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:27.451 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:27.466 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:27.467 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:45:27.467 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:27.519 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:27.520 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:27.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:45:27.691 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:27.804 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:28.119 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:04:51 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:28.252 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:45:28.253 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout:Install 11 Packages 2024-09-16T16:45:28.254 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:28.255 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 18 M 2024-09-16T16:45:28.255 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 155 M 2024-09-16T16:45:28.255 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:28.290 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:28.545 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:28.545 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:28.545 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:28.545 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:28.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:28.546 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:28.837 INFO:teuthology.orchestra.run.smithi104.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 227 kB/s | 34 kB 00:00 2024-09-16T16:45:28.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install libcephfs2 2024-09-16T16:45:28.887 INFO:teuthology.orchestra.run.smithi104.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 82 kB/s | 16 kB 00:00 2024-09-16T16:45:29.079 INFO:teuthology.orchestra.run.smithi104.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.4 MB/s | 863 kB 00:00 2024-09-16T16:45:29.137 INFO:teuthology.orchestra.run.smithi104.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T16:45:29.163 INFO:teuthology.orchestra.run.smithi104.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-16T16:45:29.355 INFO:teuthology.orchestra.run.smithi104.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 11 MB/s | 2.0 MB 00:00 2024-09-16T16:45:29.413 INFO:teuthology.orchestra.run.smithi104.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-16T16:45:29.447 INFO:teuthology.orchestra.run.smithi104.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 922 kB/s | 31 kB 00:00 2024-09-16T16:45:29.457 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:52 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:29.489 INFO:teuthology.orchestra.run.smithi104.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-16T16:45:29.550 INFO:teuthology.orchestra.run.smithi059.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:29.597 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:29.598 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:29.598 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:29.647 INFO:teuthology.orchestra.run.smithi104.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 15 MB/s | 14 MB 00:00 2024-09-16T16:45:29.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install libcephfs-devel 2024-09-16T16:45:29.681 INFO:teuthology.orchestra.run.smithi104.stdout:(11/11): python3-protobuf-3.14.0-13.el9.noarch. 319 kB/s | 269 kB 00:00 2024-09-16T16:45:29.684 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:29.684 INFO:teuthology.orchestra.run.smithi104.stdout:Total 13 MB/s | 18 MB 00:01 2024-09-16T16:45:29.713 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:29.732 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:29.732 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:29.999 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:29.999 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:30.262 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:53 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:30.404 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:30.405 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:45:30.406 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:30.406 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 32 k 2024-09-16T16:45:30.406 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 142 k 2024-09-16T16:45:30.406 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:30.548 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:30.564 INFO:teuthology.orchestra.run.smithi059.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 201 kB/s | 32 kB 00:00 2024-09-16T16:45:30.564 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:30.565 INFO:teuthology.orchestra.run.smithi059.stdout:Total 199 kB/s | 32 kB 00:00 2024-09-16T16:45:30.565 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:30.569 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:30.569 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:30.592 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:30.592 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:30.646 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:45:30.673 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:30.676 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:45:30.764 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:45:30.781 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:30.902 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:45:30.954 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:45:31.039 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:45:31.089 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:45:31.117 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:31.158 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:45:31.165 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:31.401 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:31.401 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:31.401 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:31.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install librados2 2024-09-16T16:45:32.195 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:55 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:32.289 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:32.335 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:32.336 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:32.337 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:32.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install librbd1 2024-09-16T16:45:33.004 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:56 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:33.097 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:33.143 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:33.144 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:33.144 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:33.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rados 2024-09-16T16:45:33.802 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:56 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:33.895 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:33.941 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:33.942 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:33.942 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:34.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rgw 2024-09-16T16:45:34.371 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:45:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:34.603 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:57 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:34.698 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:34.745 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:34.746 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:34.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-cephfs 2024-09-16T16:45:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:58 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:35.549 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:35.551 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:35.551 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:35.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rbd 2024-09-16T16:45:36.105 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:36.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:45:36.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:45:36.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:45:36.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:45:36.215 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:59 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:36.308 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:36.355 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:36.356 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-09-16T16:45:36.356 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:36.418 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:45:36.418 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:36.418 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:36.418 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:36.419 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:36.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-fuse 2024-09-16T16:45:36.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:45:37.020 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:05:00 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:37.159 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:37.159 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 91 k 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 321 k 2024-09-16T16:45:37.160 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:37.253 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:00 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:37.351 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 478 kB/s | 91 kB 00:00 2024-09-16T16:45:37.351 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:37.351 INFO:teuthology.orchestra.run.smithi059.stdout:Total 475 kB/s | 91 kB 00:00 2024-09-16T16:45:37.352 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:37.361 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:37.362 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:37.386 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:37.387 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-16T16:45:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:45:37.387 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:45:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout:Install 12 Packages 2024-09-16T16:45:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:37.390 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 38 M 2024-09-16T16:45:37.390 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 212 M 2024-09-16T16:45:37.390 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:37.430 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:37.430 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 965 kB/s | 191 kB 00:00 2024-09-16T16:45:37.978 INFO:teuthology.orchestra.run.smithi104.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-09-16T16:45:38.012 INFO:teuthology.orchestra.run.smithi104.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-16T16:45:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 199 kB/s | 18 kB 00:00 2024-09-16T16:45:38.170 INFO:teuthology.orchestra.run.smithi104.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 579 kB/s | 38 kB 00:00 2024-09-16T16:45:38.237 INFO:teuthology.orchestra.run.smithi104.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-16T16:45:38.288 INFO:teuthology.orchestra.run.smithi104.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-16T16:45:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:38.370 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:38.371 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:38.404 INFO:teuthology.orchestra.run.smithi104.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 5.1 MB 00:00 2024-09-16T16:45:38.455 INFO:teuthology.orchestra.run.smithi104.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-09-16T16:45:38.547 INFO:teuthology.orchestra.run.smithi104.stdout:(10/12): ceph-mgr-diskprediction-local-19.3.0-4 8.6 MB/s | 7.4 MB 00:00 2024-09-16T16:45:38.622 INFO:teuthology.orchestra.run.smithi104.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-16T16:45:38.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-mirror 2024-09-16T16:45:38.881 INFO:teuthology.orchestra.run.smithi104.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-16T16:45:38.881 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:38.882 INFO:teuthology.orchestra.run.smithi104.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-16T16:45:39.236 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:39.262 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:39.262 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:39.326 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:05:02 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:39.468 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:39.469 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:45:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:39.470 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 3.5 M 2024-09-16T16:45:39.470 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 30 M 2024-09-16T16:45:39.470 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:39.705 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:39.705 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:39.979 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 6.9 MB/s | 3.5 MB 00:00 2024-09-16T16:45:39.980 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:39.980 INFO:teuthology.orchestra.run.smithi059.stdout:Total 6.9 MB/s | 3.5 MB 00:00 2024-09-16T16:45:39.980 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:39.993 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:39.993 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:40.081 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:40.081 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:40.460 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:40.539 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:40.578 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:40.678 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:40.713 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:40.771 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:40.798 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:40.798 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:40.798 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:45:40.798 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:45:40.798 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:45:40.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:40.896 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:40.929 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:41.677 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:41.791 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:42.001 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:42.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-nbd 2024-09-16T16:45:42.862 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:05:05 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:43.002 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2024-09-16T16:45:43.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:43.004 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 177 k 2024-09-16T16:45:43.004 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 685 k 2024-09-16T16:45:43.004 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-16T16:45:43.015 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:43.214 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 840 kB/s | 177 kB 00:00 2024-09-16T16:45:43.215 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:43.215 INFO:teuthology.orchestra.run.smithi059.stdout:Total 834 kB/s | 177 kB 00:00 2024-09-16T16:45:43.215 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-16T16:45:43.226 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-16T16:45:43.226 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-16T16:45:43.301 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-16T16:45:43.301 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-16T16:45:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-16T16:45:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:44.062 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:44.094 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-16T16:45:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:45:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-16T16:45:44.528 DEBUG:teuthology.parallel:result is None 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:46.579 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:46.580 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:46.580 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:46.580 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:46.580 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:46.993 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:46.994 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:47.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:47.967 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:10 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:48.101 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:48.102 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:48.102 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:48.103 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout:Install 13 Packages 2024-09-16T16:45:48.104 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:48.105 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 2.2 M 2024-09-16T16:45:48.105 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 26 M 2024-09-16T16:45:48.105 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:48.510 INFO:teuthology.orchestra.run.smithi104.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 220 kB/s | 19 kB 00:00 2024-09-16T16:45:48.535 INFO:teuthology.orchestra.run.smithi104.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 228 kB/s | 26 kB 00:00 2024-09-16T16:45:48.593 INFO:teuthology.orchestra.run.smithi104.stdout:(3/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 288 kB/s | 49 kB 00:00 2024-09-16T16:45:48.644 INFO:teuthology.orchestra.run.smithi104.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-16T16:45:48.669 INFO:teuthology.orchestra.run.smithi104.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-16T16:45:48.694 INFO:teuthology.orchestra.run.smithi104.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-16T16:45:48.736 INFO:teuthology.orchestra.run.smithi104.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-16T16:45:48.761 INFO:teuthology.orchestra.run.smithi104.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 235 kB/s | 14 kB 00:00 2024-09-16T16:45:48.795 INFO:teuthology.orchestra.run.smithi104.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.8 MB/s | 220 kB 00:00 2024-09-16T16:45:48.821 INFO:teuthology.orchestra.run.smithi104.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T16:45:48.846 INFO:teuthology.orchestra.run.smithi104.stdout:(11/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-16T16:45:48.871 INFO:teuthology.orchestra.run.smithi104.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T16:45:48.905 INFO:teuthology.orchestra.run.smithi104.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-16T16:45:48.906 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:48.907 INFO:teuthology.orchestra.run.smithi104.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-09-16T16:45:48.970 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:48.986 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:48.986 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:49.073 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:49.073 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:49.758 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:49.814 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:49.869 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:49.907 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:49.949 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:50.057 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:50.216 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:50.924 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:50.980 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:51.014 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:51.062 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:51.084 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:51.856 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:51.856 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:51.856 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:51.857 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:52.190 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:52.461 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:53.027 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:16 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:53.160 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:53.161 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:53.161 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:45:53.161 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:53.161 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout:Install 6 Packages 2024-09-16T16:45:53.162 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:53.163 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 7.0 M 2024-09-16T16:45:53.163 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 33 M 2024-09-16T16:45:53.163 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:53.398 INFO:teuthology.orchestra.run.smithi104.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-16T16:45:53.473 INFO:teuthology.orchestra.run.smithi104.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 697 kB/s | 154 kB 00:00 2024-09-16T16:45:53.515 INFO:teuthology.orchestra.run.smithi104.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.6 MB/s | 548 kB 00:00 2024-09-16T16:45:53.549 INFO:teuthology.orchestra.run.smithi104.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.3 MB/s | 74 kB 00:00 2024-09-16T16:45:53.573 INFO:teuthology.orchestra.run.smithi104.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 575 kB/s | 58 kB 00:00 2024-09-16T16:45:53.665 INFO:teuthology.orchestra.run.smithi104.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-16T16:45:53.668 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:53.668 INFO:teuthology.orchestra.run.smithi104.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-16T16:45:53.738 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:53.750 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:53.750 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:53.851 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:53.852 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:54.173 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:54.336 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:54.909 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:54.994 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:55.063 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:55.087 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:55.867 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:55.868 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:55.868 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:55.868 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:55.868 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:55.868 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:56.138 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:56.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:56.139 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:56.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-fuse 2024-09-16T16:45:56.980 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:19 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:45:57.113 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:45:57.115 INFO:teuthology.orchestra.run.smithi104.stdout:Install 2 Packages 2024-09-16T16:45:57.116 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:57.116 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 964 k 2024-09-16T16:45:57.116 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 4.1 M 2024-09-16T16:45:57.116 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:45:57.392 INFO:teuthology.orchestra.run.smithi104.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 542 kB/s | 80 kB 00:00 2024-09-16T16:45:57.575 INFO:teuthology.orchestra.run.smithi104.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 2.6 MB/s | 884 kB 00:00 2024-09-16T16:45:57.576 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:57.576 INFO:teuthology.orchestra.run.smithi104.stdout:Total 2.0 MB/s | 964 kB 00:00 2024-09-16T16:45:57.588 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:45:57.612 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:45:57.612 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:45:57.692 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:45:57.692 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:45:57.875 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:45:58.021 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:58.091 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:58.775 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:58.775 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:59.072 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:59.072 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:59.073 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:45:59.073 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:59.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:45:59.073 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:45:59.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-volume 2024-09-16T16:45:59.923 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:22 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:00.061 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 285 k 2024-09-16T16:46:00.062 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 1.3 M 2024-09-16T16:46:00.063 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:46:00.271 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-16T16:46:00.271 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:00.271 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-16T16:46:00.272 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:46:00.280 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:46:00.280 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:46:00.310 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:46:00.311 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:46:00.529 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:46:00.589 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:46:00.606 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:46:00.606 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:00.606 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:46:00.606 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:46:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:01.637 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:46:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:46:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:01.637 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:02.001 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librados-devel 2024-09-16T16:46:02.586 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:25 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:02.721 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 125 k 2024-09-16T16:46:02.722 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 445 k 2024-09-16T16:46:02.723 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:46:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 643 kB/s | 125 kB 00:00 2024-09-16T16:46:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:Total 638 kB/s | 125 kB 00:00 2024-09-16T16:46:02.918 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:46:02.923 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:46:02.923 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:46:02.986 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:46:02.987 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:46:03.152 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:46:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:03.739 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:04.005 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:04.006 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:04.006 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:46:04.006 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:04.006 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:04.006 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:04.242 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install libcephfs2 2024-09-16T16:46:04.831 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:27 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:04.925 INFO:teuthology.orchestra.run.smithi104.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:04.972 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:04.973 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:04.973 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:05.047 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install libcephfs-devel 2024-09-16T16:46:05.637 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:28 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:05.775 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:46:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:05.777 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 32 k 2024-09-16T16:46:05.777 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 142 k 2024-09-16T16:46:05.777 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:46:05.945 INFO:teuthology.orchestra.run.smithi104.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 189 kB/s | 32 kB 00:00 2024-09-16T16:46:05.946 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:05.946 INFO:teuthology.orchestra.run.smithi104.stdout:Total 187 kB/s | 32 kB 00:00 2024-09-16T16:46:05.946 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:46:05.949 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:46:05.950 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:46:05.970 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:46:05.971 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:46:06.063 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:46:06.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:06.616 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:06.860 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:06.861 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:06.861 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:46:06.861 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:06.861 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:06.861 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:07.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librados2 2024-09-16T16:46:07.628 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:30 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:07.717 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:07.760 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:07.761 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:07.762 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:07.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librbd1 2024-09-16T16:46:08.398 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:31 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:08.488 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:08.530 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:08.532 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:08.532 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:08.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rados 2024-09-16T16:46:09.162 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:32 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:09.253 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:09.296 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:09.297 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:09.297 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:09.362 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rgw 2024-09-16T16:46:09.930 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:32 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:10.021 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:10.065 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:10.066 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:10.066 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:10.127 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-cephfs 2024-09-16T16:46:10.689 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:33 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:10.779 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:10.821 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:10.822 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:10.823 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:10.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rbd 2024-09-16T16:46:11.451 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:34 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:11.544 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:11.588 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:11.589 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-16T16:46:11.589 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:11.652 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-fuse 2024-09-16T16:46:12.217 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:35 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:12.350 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:12.351 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:12.351 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:12.351 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:12.351 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:46:12.352 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:46:12.352 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:12.352 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:46:12.352 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:12.352 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:46:12.353 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:12.353 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 91 k 2024-09-16T16:46:12.353 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 321 k 2024-09-16T16:46:12.353 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:46:12.532 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 505 kB/s | 91 kB 00:00 2024-09-16T16:46:12.532 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:12.532 INFO:teuthology.orchestra.run.smithi104.stdout:Total 501 kB/s | 91 kB 00:00 2024-09-16T16:46:12.533 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:46:12.541 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:46:12.541 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:46:12.605 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:46:12.605 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:46:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:46:12.871 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:13.259 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:13.508 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:13.508 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:13.508 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:46:13.509 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:13.509 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:13.509 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:13.802 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-mirror 2024-09-16T16:46:14.379 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:37 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:14.517 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:14.517 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 3.5 M 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 30 M 2024-09-16T16:46:14.518 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:46:14.851 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-16T16:46:14.852 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:14.852 INFO:teuthology.orchestra.run.smithi104.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-16T16:46:14.853 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:46:14.864 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:46:14.864 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:46:14.947 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:46:14.947 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:46:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:46:15.618 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.644 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.645 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:15.645 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:46:15.645 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:15.645 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:15.645 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:16.960 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:46:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:16.961 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:17.204 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-nbd 2024-09-16T16:46:17.779 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:05:40 ago on Mon 16 Sep 2024 04:40:37 PM UTC. 2024-09-16T16:46:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-16T16:46:17.915 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:17.915 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 177 k 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 685 k 2024-09-16T16:46:17.916 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-16T16:46:18.130 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 828 kB/s | 177 kB 00:00 2024-09-16T16:46:18.130 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:18.131 INFO:teuthology.orchestra.run.smithi104.stdout:Total 823 kB/s | 177 kB 00:00 2024-09-16T16:46:18.131 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-16T16:46:18.140 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-16T16:46:18.140 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-16T16:46:18.209 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-16T16:46:18.210 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-16T16:46:18.377 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-16T16:46:18.485 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:18.919 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:19.200 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:19.200 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:19.200 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-16T16:46:19.200 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:19.200 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:19.200 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-16T16:46:19.466 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:19.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:19.614 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:19.642 INFO:teuthology.orchestra.run.smithi059.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:19.642 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:19.642 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:19.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:19.790 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:19.812 INFO:teuthology.orchestra.run.smithi104.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:19.812 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:19.812 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:19.814 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T16:46:19.814 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:19.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:19.846 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:19.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:19.878 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T16:46:19.878 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:19.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:19.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:19.985 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:19.985 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:20.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:20.075 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T16:46:20.076 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:20.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:20.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:20.172 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:20.172 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:20.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:20.261 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T16:46:20.262 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:20.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:20.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:20.353 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:20.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:20.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:20.442 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T16:46:20.521 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T16:46:20.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:20.523 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:20.548 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T16:46:20.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:20.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:20.614 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T16:46:20.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:20.657 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:20.689 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T16:46:20.689 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T16:46:20.690 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7907361', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6678, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+6CltMic5kh/l8tyWpFi6n7MgFl713vNqHaObWLotSOCb3oRLelgI25WTtajIB+0ZRXDzUfEb+ADdLzOV2FjU=', 'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCJ5MsbCj0bf6YRmXDhojoClJl5onOClsb6qjRcuCLEl3mJ4YbpxdQT+2uS7UEsFKRlTZQL/U0MlMv77A8MP/g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_16:23:48', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T16:46:20.690 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:20.724 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:20.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:20.781 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:20.806 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:20.806 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:20.862 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:20.862 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:20.917 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-16 16:45:41.057331123 +0000 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-16 16:39:56.732927870 +0000 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-16 16:39:56.732927870 +0000 2024-09-16T16:46:20.918 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-16 16:39:56.732927870 +0000 2024-09-16T16:46:20.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:20.981 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-16T16:46:20.982 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-16T16:46:20.982 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000252417 s, 2.0 MB/s 2024-09-16T16:46:20.983 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:21.040 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-16 16:45:41.058331110 +0000 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-16 16:39:57.067923523 +0000 2024-09-16T16:46:21.097 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-16 16:39:57.067923523 +0000 2024-09-16T16:46:21.098 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-16 16:39:57.067923523 +0000 2024-09-16T16:46:21.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-16T16:46:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-16T16:46:21.161 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000215453 s, 2.4 MB/s 2024-09-16T16:46:21.162 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:21.218 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-16 16:45:41.058331110 +0000 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-16 16:39:57.405919136 +0000 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-16 16:39:57.405919136 +0000 2024-09-16T16:46:21.274 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-16 16:39:57.405919136 +0000 2024-09-16T16:46:21.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-16T16:46:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-16T16:46:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000209868 s, 2.4 MB/s 2024-09-16T16:46:21.339 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:21.396 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-16 16:45:41.059331097 +0000 2024-09-16T16:46:21.452 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-16 16:39:57.756914580 +0000 2024-09-16T16:46:21.453 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-16 16:39:57.756914580 +0000 2024-09-16T16:46:21.453 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-16 16:39:57.756914580 +0000 2024-09-16T16:46:21.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:21.516 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-16T16:46:21.516 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-16T16:46:21.516 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000190845 s, 2.7 MB/s 2024-09-16T16:46:21.518 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:21.576 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:21.576 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:21.576 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:21.593 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:21.593 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:21.649 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:21.649 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:21.649 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T16:46:21.649 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:21.650 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:21.650 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-16 16:46:15.919774739 +0000 2024-09-16T16:46:21.650 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-16 16:39:55.427432919 +0000 2024-09-16T16:46:21.650 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-16 16:39:55.427432919 +0000 2024-09-16T16:46:21.650 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-16 16:39:55.427432919 +0000 2024-09-16T16:46:21.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:21.713 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-16T16:46:21.714 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-16T16:46:21.714 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000213471 s, 2.4 MB/s 2024-09-16T16:46:21.715 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:21.772 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-16 16:46:15.919774739 +0000 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-16 16:39:55.748429369 +0000 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-16 16:39:55.748429369 +0000 2024-09-16T16:46:21.828 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-16 16:39:55.748429369 +0000 2024-09-16T16:46:21.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:21.892 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-16T16:46:21.892 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-16T16:46:21.892 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000301769 s, 1.7 MB/s 2024-09-16T16:46:21.893 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:21.949 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:22.004 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:22.004 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:22.004 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T16:46:22.004 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:22.004 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:22.005 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-16 16:46:15.920774728 +0000 2024-09-16T16:46:22.005 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-16 16:39:56.076425741 +0000 2024-09-16T16:46:22.005 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-16 16:39:56.076425741 +0000 2024-09-16T16:46:22.005 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-16 16:39:56.076425741 +0000 2024-09-16T16:46:22.005 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:22.066 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-16T16:46:22.067 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-16T16:46:22.067 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000212037 s, 2.4 MB/s 2024-09-16T16:46:22.068 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:22.124 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-16 16:46:15.920774728 +0000 2024-09-16T16:46:22.179 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-16 16:39:56.440421716 +0000 2024-09-16T16:46:22.180 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-16 16:39:56.440421716 +0000 2024-09-16T16:46:22.180 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-16 16:39:56.440421716 +0000 2024-09-16T16:46:22.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:22.242 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-16T16:46:22.242 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-16T16:46:22.242 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00020707 s, 2.5 MB/s 2024-09-16T16:46:22.243 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:22.299 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:22.299 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:22.299 INFO:tasks.ceph:Generating config... 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T16:46:22.301 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-16T16:46:22.302 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T16:46:22.302 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-16T16:46:22.303 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T16:46:22.304 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T16:46:22.304 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T16:46:22.304 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T16:46:22.304 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T16:46:22.304 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T16:46:22.304 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T16:46:22.304 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T16:46:22.305 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T16:46:22.305 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T16:46:22.305 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T16:46:22.305 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T16:46:22.305 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T16:46:22.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:22.376 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T16:46:22.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T16:46:22.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:22.459 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59')] 2024-09-16T16:46:22.460 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T16:46:22.460 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:22.461 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:22.515 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:22.608+0000 7fbf7ef0bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:22.608+0000 7fbf7ef0bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:22.608+0000 7fbf7ef0bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid c43301f4-656b-4707-8343-bef82748353c 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stdout:fsid c43301f4-656b-4707-8343-bef82748353c 2024-09-16T16:46:22.609 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2024-09-16T16:46:22.609427+0000 2024-09-16T16:46:22.610 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-16T16:46:22.609427+0000 2024-09-16T16:46:22.610 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 17 (quincy) 2024-09-16T16:46:22.610 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2024-09-16T16:46:22.610 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-16T16:46:22.610 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T16:46:22.611 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:22.626 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c43301f4-656b-4707-8343-bef82748353c... 2024-09-16T16:46:22.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:22.670 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-09-16T16:46:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:22.713 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.714 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = 172.21.15.59 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: ms client mode = crc 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: ms cluster mode = crc 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: ms mon client mode = crc 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: ms mon cluster mode = crc 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: ms mon service mode = crc 2024-09-16T16:46:22.715 INFO:teuthology.orchestra.run.smithi059.stdout: ms service mode = crc 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = c43301f4-656b-4707-8343-bef82748353c 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-09-16T16:46:22.716 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:22.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: debug monc = 20 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore compression algorithm = snappy 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore compression mode = aggressive 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore rocksdb cf = False 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-09-16T16:46:22.718 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: err to stderr = True 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: log flush on exit = True 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: log to file = False 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: log to stderr = True 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: osd class default list = * 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: osd class load list = * 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: mgr stats period = 30 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-09-16T16:46:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.721 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: paxos service trim min = 10 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on pool no app = False 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default crimson = True 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-09-16T16:46:22.722 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-09-16T16:46:22.723 INFO:teuthology.orchestra.run.smithi059.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-09-16T16:46:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = 172.21.15.59 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ms client mode = crc 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ms cluster mode = crc 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ms mon client mode = crc 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ms mon cluster mode = crc 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ms mon service mode = crc 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ms service mode = crc 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = c43301f4-656b-4707-8343-bef82748353c 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.727 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-09-16T16:46:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: debug monc = 20 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore compression algorithm = snappy 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore compression mode = aggressive 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore rocksdb cf = False 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 20 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 20 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 10 2024-09-16T16:46:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: err to stderr = True 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: log flush on exit = True 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: log to file = False 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: log to stderr = True 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: osd class default list = * 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: osd class load list = * 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-09-16T16:46:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: mgr stats period = 30 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-09-16T16:46:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-09-16T16:46:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: paxos service trim min = 10 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on pool no app = False 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default crimson = True 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-09-16T16:46:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-09-16T16:46:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:22.736 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T16:46:22.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T16:46:22.841 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T16:46:22.842 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:22.842 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T16:46:22.857 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:22.858 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T16:46:22.915 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T16:46:22.915 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:22.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:22.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:22.990 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:22.991 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:23.047 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T16:46:23.047 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:23.047 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:23.047 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:23.082 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:23.082 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:23.138 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T16:46:23.138 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T16:46:23.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:23.250 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:23.253 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T16:46:23.254 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T16:46:23.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:23.304 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:23.318 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:23.368 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:23.381 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T16:46:23.381 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:23.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:23.407 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:23.407 INFO:tasks.ceph:role: osd.0 2024-09-16T16:46:23.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T16:46:23.407 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:23.480 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:23.481 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:23.980 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-09-16T16:46:23.982 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-09-16T16:46:23.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:24.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:24.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:24.233 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:24.233 INFO:tasks.ceph:role: osd.1 2024-09-16T16:46:24.233 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T16:46:24.233 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:24.306 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:24.307 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:24.750 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-09-16T16:46:24.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-09-16T16:46:24.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:24.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:24.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:25.214 INFO:teuthology.orchestra.run.smithi059.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:25.215 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:25,216 seastar - Reactor backend: linux-aio 2024-09-16T16:46:25.231 INFO:teuthology.orchestra.run.smithi059.stderr:==27613==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:25.340 INFO:teuthology.orchestra.run.smithi059.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x396d212 0x45855a2 0x4621f13 0x5fdbff1 0x5fdc222 0x5fb92bb 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:25.340 INFO:teuthology.orchestra.run.smithi059.stderr:kernel callstack: 2024-09-16T16:46:25.361 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:25,362 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:25,362 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:DEBUG 2024-09-16 16:46:25,363 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:25.924 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:Suppressions used: 2024-09-16T16:46:25.925 INFO:teuthology.orchestra.run.smithi059.stderr: count bytes template 2024-09-16T16:46:25.925 INFO:teuthology.orchestra.run.smithi059.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:25.925 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:25.925 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T16:46:25.987 INFO:teuthology.orchestra.run.smithi059.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:25.991 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:25,992 seastar - Reactor backend: linux-aio 2024-09-16T16:46:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:==27611==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x15957f 0xc928c 0xc9e39 0x36084f8 0x362c847 0x362ca9c 0x5fb0d8b 0x5fd278c 0x5fd2a26 0x5fb964c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:kernel callstack: 2024-09-16T16:46:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:30.776 INFO:teuthology.orchestra.run.smithi059.stderr:Suppressions used: 2024-09-16T16:46:30.777 INFO:teuthology.orchestra.run.smithi059.stderr: count bytes template 2024-09-16T16:46:30.777 INFO:teuthology.orchestra.run.smithi059.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:30.777 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:30.777 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T16:46:30.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:30.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:31.115 INFO:teuthology.orchestra.run.smithi059.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:31.116 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:31,117 seastar - Reactor backend: linux-aio 2024-09-16T16:46:31.122 INFO:teuthology.orchestra.run.smithi059.stderr:==27799==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x15979c 0xc928c 0xc9e39 0x36084f8 0x396d169 0x5c0b2b9 0x5c0fc2d 0x5e6e00b 0x5e6e2c0 0x5e15487 0x5e1812d 0x5e18d44 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:31.230 INFO:teuthology.orchestra.run.smithi059.stderr:kernel callstack: 2024-09-16T16:46:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:31,253 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:31,253 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:31.253 INFO:teuthology.orchestra.run.smithi059.stderr:DEBUG 2024-09-16 16:46:31,254 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi059.stderr:Suppressions used: 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi059.stderr: count bytes template 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi059.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T16:46:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:31.858 INFO:teuthology.orchestra.run.smithi059.stderr:INFO 2024-09-16 16:46:31,859 seastar - Reactor backend: linux-aio 2024-09-16T16:46:31.868 INFO:teuthology.orchestra.run.smithi059.stderr:==27797==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:31.933 INFO:teuthology.orchestra.run.smithi059.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156f9 0xdd312 0x4b14c 0x381b234 0x6038986 0x6038bb9 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:31.933 INFO:teuthology.orchestra.run.smithi059.stderr:kernel callstack: 2024-09-16T16:46:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:Suppressions used: 2024-09-16T16:46:36.866 INFO:teuthology.orchestra.run.smithi059.stderr: count bytes template 2024-09-16T16:46:36.866 INFO:teuthology.orchestra.run.smithi059.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:----------------------------------------------------- 2024-09-16T16:46:36.866 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T16:46:36.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:36.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:36.944 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:36.944 INFO:tasks.ceph:role: osd.2 2024-09-16T16:46:36.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T16:46:36.944 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:37.020 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:37.021 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:37.021 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:37.021 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:37.534 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-16T16:46:37.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-16T16:46:37.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:37.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:37.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:37.787 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:37.787 INFO:tasks.ceph:role: osd.3 2024-09-16T16:46:37.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T16:46:37.787 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:37.859 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:37.860 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:37.860 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-16T16:46:38.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-16T16:46:38.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:38.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:38.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:38.716 INFO:teuthology.orchestra.run.smithi104.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:38,718 seastar - Reactor backend: linux-aio 2024-09-16T16:46:38.732 INFO:teuthology.orchestra.run.smithi104.stderr:==27644==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:38.853 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:38,853 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:38.853 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:38,853 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:38.854 INFO:teuthology.orchestra.run.smithi104.stderr:DEBUG 2024-09-16 16:46:38,854 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:39.375 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:39.376 INFO:teuthology.orchestra.run.smithi104.stderr:Suppressions used: 2024-09-16T16:46:39.376 INFO:teuthology.orchestra.run.smithi104.stderr: count bytes template 2024-09-16T16:46:39.376 INFO:teuthology.orchestra.run.smithi104.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:39.376 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:39.376 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-16T16:46:39.436 INFO:teuthology.orchestra.run.smithi104.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:39.440 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:39,440 seastar - Reactor backend: linux-aio 2024-09-16T16:46:39.449 INFO:teuthology.orchestra.run.smithi104.stderr:==27641==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:39.514 INFO:teuthology.orchestra.run.smithi104.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd323 0x4ab1c 0x5550e6a 0x5fb4987 0x5fb8f6a 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:39.514 INFO:teuthology.orchestra.run.smithi104.stderr:kernel callstack: 2024-09-16T16:46:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:Suppressions used: 2024-09-16T16:46:44.153 INFO:teuthology.orchestra.run.smithi104.stderr: count bytes template 2024-09-16T16:46:44.153 INFO:teuthology.orchestra.run.smithi104.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:44.153 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-16T16:46:44.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:44.200 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:44.474 INFO:teuthology.orchestra.run.smithi104.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:44.475 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:44,476 seastar - Reactor backend: linux-aio 2024-09-16T16:46:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:==27830==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:44.587 INFO:teuthology.orchestra.run.smithi104.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b568 0x10d76c 0xdd31a 0x4ab1c 0x3613f13 0x5550a31 0x5550e5b 0x5fb4987 0x5fb8f6a 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:44.587 INFO:teuthology.orchestra.run.smithi104.stderr:kernel callstack: 2024-09-16T16:46:44.603 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:44,603 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:44.603 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:44,603 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:44.603 INFO:teuthology.orchestra.run.smithi104.stderr:DEBUG 2024-09-16 16:46:44,604 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:Suppressions used: 2024-09-16T16:46:45.102 INFO:teuthology.orchestra.run.smithi104.stderr: count bytes template 2024-09-16T16:46:45.102 INFO:teuthology.orchestra.run.smithi104.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:45.102 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-16T16:46:45.160 INFO:teuthology.orchestra.run.smithi104.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:45.164 INFO:teuthology.orchestra.run.smithi104.stderr:INFO 2024-09-16 16:46:45,164 seastar - Reactor backend: linux-aio 2024-09-16T16:46:45.182 INFO:teuthology.orchestra.run.smithi104.stderr:==27828==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:50.124 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:50.124 INFO:teuthology.orchestra.run.smithi104.stderr:Suppressions used: 2024-09-16T16:46:50.124 INFO:teuthology.orchestra.run.smithi104.stderr: count bytes template 2024-09-16T16:46:50.124 INFO:teuthology.orchestra.run.smithi104.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:50.124 INFO:teuthology.orchestra.run.smithi104.stderr:----------------------------------------------------- 2024-09-16T16:46:50.124 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-16T16:46:50.145 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:50.170 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T16:46:50.170 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:50.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T16:46:50.201 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:50.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T16:46:50.271 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:50.272 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T16:46:50.296 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:50.296 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T16:46:50.361 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:50.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T16:46:50.425 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:50.426 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T16:46:50.445 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:50.445 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T16:46:50.480 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T16:46:50.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDiYOhmgaWwCRAAMAhlamb79FRiJNiJvKRmvQ== 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDoYOhm4svbARAARuOoh8ZJv/7ZlT79Mior3w== 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDfYOhmTh31DhAAbSy6L+8li2T0Mvu/AzvXWw== 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-09-16T16:46:50.514 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDvYOhmnBGfIxAAApA5/P1/kvrwmztDI+G4NQ== 2024-09-16T16:46:50.515 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-09-16T16:46:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD1YOhmL5CvExAAWzS0D/eOuiCZPRyndAZFVA== 2024-09-16T16:46:50.515 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-09-16T16:46:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDfYOhmrCwxEhAA7/9aIYxuAzYiozlhgXaVQg== 2024-09-16T16:46:50.515 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2024-09-16T16:46:50.515 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDfYOhmMgT5FRAAjcUqcbeF7cFTzGvwobGvVQ== 2024-09-16T16:46:50.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:50.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:50.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T16:46:50.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:50.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:50.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:50.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:51.013 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T16:46:51.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:51.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:51.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.153+0000 7f3ea5e49c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.153+0000 7f3ea5e49c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:51.192 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:51.247 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T16:46:51.248 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T16:46:51.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T16:46:51.290 INFO:tasks.ceph.mon.a:Started 2024-09-16T16:46:51.291 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T16:46:51.291 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T16:46:51.291 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T16:46:51.293 INFO:tasks.ceph.mgr.x:Started 2024-09-16T16:46:51.294 DEBUG:tasks.ceph:set 0 configs 2024-09-16T16:46:51.294 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T16:46:51.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T16:46:51.376 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-16T16:46:51.375+0000 7f5dbf4d7c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.376 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-16T16:46:51.375+0000 7f5dbf4d7c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.376 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-16T16:46:51.375+0000 7f5dbf4d7c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.395 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-09-16T16:46:51.395+0000 7f16c89c5000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.400+0000 7f14c7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.407+0000 7f14c7591640 1 Processor -- start 2024-09-16T16:46:51.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.407+0000 7f14c7591640 1 -- start start 2024-09-16T16:46:51.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c7591640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14c01341e0 0x7f14c01390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c7591640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00a2a30 con 0x7f14c009d8c0 2024-09-16T16:46:51.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c7591640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f14c009fbe0 con 0x7f14c01341e0 2024-09-16T16:46:51.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c4b2c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14c01341e0 0x7f14c01390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c532d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14c009d8c0 0x7f14c0133ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44470/0 (socket says 172.21.15.59:44470) 2024-09-16T16:46:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c4b2c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14c01341e0 0x7f14c01390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57204/0 (socket says 172.21.15.59:57204) 2024-09-16T16:46:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c532d640 1 -- 172.21.15.59:0/276245481 learned_addr learned my addr 172.21.15.59:0/276245481 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:46:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c4b2c640 1 -- 172.21.15.59:0/276245481 >> v1:172.21.15.59:6789/0 conn(0x7f14c009d8c0 legacy=0x7f14c0133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.409+0000 7f14c4b2c640 1 -- 172.21.15.59:0/276245481 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c009e150 con 0x7f14c01341e0 2024-09-16T16:46:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.411+0000 7f14c4b2c640 1 --2- 172.21.15.59:0/276245481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c01341e0 0x7f14c01390d0 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cf4d469a79ba93 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.411+0000 7f14b7fff640 1 -- 172.21.15.59:0/276245481 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f14b0009d80 con 0x7f14c01341e0 2024-09-16T16:46:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.411+0000 7f14b7fff640 1 -- 172.21.15.59:0/276245481 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f14b000e230 con 0x7f14c01341e0 2024-09-16T16:46:51.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.411+0000 7f14b7fff640 1 -- 172.21.15.59:0/276245481 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f14b000e4d0 con 0x7f14c01341e0 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 -- 172.21.15.59:0/276245481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c01341e0 msgr2=0x7f14c01390d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 --2- 172.21.15.59:0/276245481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c01341e0 0x7f14c01390d0 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 -- 172.21.15.59:0/276245481 shutdown_connections 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 --2- 172.21.15.59:0/276245481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c01341e0 0x7f14c01390d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 -- 172.21.15.59:0/276245481 >> 172.21.15.59:0/276245481 conn(0x7f14c00a2eb0 msgr2=0x7f14c00a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 -- 172.21.15.59:0/276245481 shutdown_connections 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 1 -- 172.21.15.59:0/276245481 wait complete. 2024-09-16T16:46:51.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.412+0000 7f14c7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.414 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-09-16T16:46:51.412+0000 7f16c89c5000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.414 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-09-16T16:46:51.412+0000 7f16c89c5000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.414+0000 7f14c7591640 1 Processor -- start 2024-09-16T16:46:51.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.414+0000 7f14c7591640 1 -- start start 2024-09-16T16:46:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c7591640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 0x7f14c006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c7591640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14c006fc40 con 0x7f14c009d8c0 2024-09-16T16:46:51.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c532d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 0x7f14c006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c532d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 0x7f14c006e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57206/0 (socket says 172.21.15.59:57206) 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c532d640 1 -- 172.21.15.59:0/3026042757 learned_addr learned my addr 172.21.15.59:0/3026042757 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c532d640 1 -- 172.21.15.59:0/3026042757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c00747e0 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.416+0000 7f14c532d640 1 --2- 172.21.15.59:0/3026042757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 0x7f14c006e900 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f14bc005a60 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f14bc005bc0 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c0125550 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f14bc005e60 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f14bc00cb80 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c0123e10 con 0x7f14c009d8c0 2024-09-16T16:46:51.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.417+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f14bc0073f0 con 0x7f14c009d8c0 2024-09-16T16:46:51.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.418+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c0133ad0 con 0x7f14c009d8c0 2024-09-16T16:46:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.420+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f14bc0075b0 con 0x7f14c009d8c0 2024-09-16T16:46:51.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.485+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f14c0050fc0 con 0x7f14c009d8c0 2024-09-16T16:46:51.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.486+0000 7f14b5ffb640 1 -- 172.21.15.59:0/3026042757 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f14bc007750 con 0x7f14c009d8c0 2024-09-16T16:46:51.487 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 msgr2=0x7f14c006e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 --2- 172.21.15.59:0/3026042757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 0x7f14c006e900 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 shutdown_connections 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 --2- 172.21.15.59:0/3026042757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14c009d8c0 0x7f14c006e900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 >> 172.21.15.59:0/3026042757 conn(0x7f14c00a2eb0 msgr2=0x7f14c01bbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 shutdown_connections 2024-09-16T16:46:51.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.487+0000 7f14c7591640 1 -- 172.21.15.59:0/3026042757 wait complete. 2024-09-16T16:46:51.498 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T16:46:51.498 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T16:46:51.498 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T16:46:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.603+0000 7fbaf729c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.609+0000 7fbaf729c640 1 Processor -- start 2024-09-16T16:46:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.609+0000 7fbaf729c640 1 -- start start 2024-09-16T16:46:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf729c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaf0134770 0x7fbaf01391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf729c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf00a2590 con 0x7fbaf0133c50 2024-09-16T16:46:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf729c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf00a2c00 con 0x7fbaf0134770 2024-09-16T16:46:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf4837640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaf0134770 0x7fbaf01391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf5038640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbaf0133c50 0x7fbaf0134060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44486/0 (socket says 172.21.15.59:44486) 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf5038640 1 -- 172.21.15.59:0/2407386728 learned_addr learned my addr 172.21.15.59:0/2407386728 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf4837640 1 -- 172.21.15.59:0/2407386728 >> v1:172.21.15.59:6789/0 conn(0x7fbaf0133c50 legacy=0x7fbaf0134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbaf4837640 1 -- 172.21.15.59:0/2407386728 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf009dfb0 con 0x7fbaf0134770 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.611+0000 7fbae7fff640 1 -- 172.21.15.59:0/2407386728 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518729046 0 0) 0x7fbaf00a2590 con 0x7fbaf0133c50 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbaf4837640 1 --2- 172.21.15.59:0/2407386728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0134770 0x7fbaf01391e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57fa4d848433772 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbae7fff640 1 -- 172.21.15.59:0/2407386728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbae0009d90 con 0x7fbaf0134770 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbae7fff640 1 -- 172.21.15.59:0/2407386728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbae000e230 con 0x7fbaf0134770 2024-09-16T16:46:51.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbae7fff640 1 -- 172.21.15.59:0/2407386728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbae000e4d0 con 0x7fbaf0134770 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbaf729c640 1 -- 172.21.15.59:0/2407386728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0134770 msgr2=0x7fbaf01391e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbaf729c640 1 --2- 172.21.15.59:0/2407386728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0134770 0x7fbaf01391e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbaf729c640 1 -- 172.21.15.59:0/2407386728 shutdown_connections 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbaf729c640 1 --2- 172.21.15.59:0/2407386728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0134770 0x7fbaf01391e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.612+0000 7fbaf729c640 1 -- 172.21.15.59:0/2407386728 >> 172.21.15.59:0/2407386728 conn(0x7fbaf00a3050 msgr2=0x7fbaf00a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.613+0000 7fbaf729c640 1 -- 172.21.15.59:0/2407386728 shutdown_connections 2024-09-16T16:46:51.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.613+0000 7fbaf729c640 1 -- 172.21.15.59:0/2407386728 wait complete. 2024-09-16T16:46:51.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.613+0000 7fbaf729c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.614+0000 7fbaf729c640 1 Processor -- start 2024-09-16T16:46:51.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.615+0000 7fbaf729c640 1 -- start start 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.616+0000 7fbaf729c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 0x7fbaf006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.616+0000 7fbaf729c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0133a70 con 0x7fbaf0133c50 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.616+0000 7fbaf5038640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 0x7fbaf006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.616+0000 7fbaf5038640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 0x7fbaf006e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57220/0 (socket says 172.21.15.59:57220) 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.616+0000 7fbaf5038640 1 -- 172.21.15.59:0/3655948317 learned_addr learned my addr 172.21.15.59:0/3655948317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.616+0000 7fbaf5038640 1 -- 172.21.15.59:0/3655948317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf0133450 con 0x7fbaf0133c50 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbaf5038640 1 --2- 172.21.15.59:0/3655948317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 0x7fbaf006e8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaec004b80 con 0x7fbaf0133c50 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaec004ce0 con 0x7fbaf0133c50 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf01251c0 con 0x7fbaf0133c50 2024-09-16T16:46:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaec007120 con 0x7fbaf0133c50 2024-09-16T16:46:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fbaec00c520 con 0x7fbaf0133c50 2024-09-16T16:46:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf0126670 con 0x7fbaf0133c50 2024-09-16T16:46:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.617+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fbaec00cd90 con 0x7fbaf0133c50 2024-09-16T16:46:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.618+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf0124f10 con 0x7fbaf0133c50 2024-09-16T16:46:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.620+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fbaec007660 con 0x7fbaf0133c50 2024-09-16T16:46:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:51.695+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fbaf0134060 con 0x7fbaf0133c50 2024-09-16T16:46:51.696 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-09-16T16:46:51.696+0000 7f5db61f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T16:46:51.696 INFO:tasks.ceph.mon.a.smithi059.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T16:46:51.696 INFO:tasks.ceph.mon.a.smithi059.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T16:46:51.696 INFO:tasks.ceph.mon.a.smithi059.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T16:46:51.696 INFO:tasks.ceph.mon.a.smithi059.stderr:feature with important data. 2024-09-16T16:46:51.696 INFO:tasks.ceph.mon.a.smithi059.stderr: 2024-09-16T16:46:52.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.487+0000 7fbae5ffb640 1 -- 172.21.15.59:0/3655948317 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fbaec00e290 con 0x7fbaf0133c50 2024-09-16T16:46:52.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 msgr2=0x7fbaf006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 --2- 172.21.15.59:0/3655948317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 0x7fbaf006e8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 shutdown_connections 2024-09-16T16:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 --2- 172.21.15.59:0/3655948317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaf0133c50 0x7fbaf006e8d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 >> 172.21.15.59:0/3655948317 conn(0x7fbaf00a3050 msgr2=0x7fbaf00720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 shutdown_connections 2024-09-16T16:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:52.489+0000 7fbaf729c640 1 -- 172.21.15.59:0/3655948317 wait complete. 2024-09-16T16:46:52.503 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T16:46:52.503 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:52.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T16:46:52.533 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:46:52.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T16:46:52.601 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:52.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T16:46:52.627 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-16T16:46:52.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T16:46:52.691 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 70230068-ea94-49e2-a797-ef4f17b0c695 0 2024-09-16T16:46:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.831+0000 7f58b6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.838+0000 7f58b6791640 1 Processor -- start 2024-09-16T16:46:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.838+0000 7f58b6791640 1 -- start start 2024-09-16T16:46:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.838+0000 7f58b6791640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58b011d970 0x7f58b011fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.838+0000 7f58b6791640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b01204a0 con 0x7f58b011acb0 2024-09-16T16:46:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.838+0000 7f58b6791640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f58b0121660 con 0x7f58b011d970 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58a7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58b011d970 0x7f58b011fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58a7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58b011d970 0x7f58b011fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51592/0 (socket says 172.21.15.104:51592) 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58a7fff640 1 -- 172.21.15.104:0/1823187299 learned_addr learned my addr 172.21.15.104:0/1823187299 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58affff640 1 --1- 172.21.15.104:0/1823187299 >> v1:172.21.15.59:6789/0 conn(0x7f58b011acb0 0x7f58b011b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.104:54394/0 (socket says 172.21.15.104:54394) 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58a7fff640 1 -- 172.21.15.104:0/1823187299 >> v1:172.21.15.59:6789/0 conn(0x7f58b011acb0 legacy=0x7f58b011b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58a7fff640 1 -- 172.21.15.104:0/1823187299 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b01217d0 con 0x7f58b011d970 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58a7fff640 1 --2- 172.21.15.104:0/1823187299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011d970 0x7f58b011fdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a18217f445496e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58af7fe640 1 -- 172.21.15.104:0/1823187299 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5898009e50 con 0x7f58b011d970 2024-09-16T16:46:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58af7fe640 1 -- 172.21.15.104:0/1823187299 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f589800e230 con 0x7f58b011d970 2024-09-16T16:46:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.839+0000 7f58af7fe640 1 -- 172.21.15.104:0/1823187299 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f589800e4d0 con 0x7f58b011d970 2024-09-16T16:46:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 -- 172.21.15.104:0/1823187299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011d970 msgr2=0x7f58b011fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 --2- 172.21.15.104:0/1823187299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011d970 0x7f58b011fdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 -- 172.21.15.104:0/1823187299 shutdown_connections 2024-09-16T16:46:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 --2- 172.21.15.104:0/1823187299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011d970 0x7f58b011fdf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 -- 172.21.15.104:0/1823187299 >> 172.21.15.104:0/1823187299 conn(0x7f58b006e9b0 msgr2=0x7f58b006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 -- 172.21.15.104:0/1823187299 shutdown_connections 2024-09-16T16:46:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.840+0000 7f58b6791640 1 -- 172.21.15.104:0/1823187299 wait complete. 2024-09-16T16:46:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.841+0000 7f58b6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.841+0000 7f58b6791640 1 Processor -- start 2024-09-16T16:46:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.841+0000 7f58b6791640 1 -- start start 2024-09-16T16:46:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.842+0000 7f58b6791640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 0x7f58b01a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.842+0000 7f58b6791640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01aa170 con 0x7f58b011acb0 2024-09-16T16:46:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.842+0000 7f58affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 0x7f58b01a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.842+0000 7f58affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 0x7f58b01a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51594/0 (socket says 172.21.15.104:51594) 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.842+0000 7f58affff640 1 -- 172.21.15.104:0/2563129382 learned_addr learned my addr 172.21.15.104:0/2563129382 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.842+0000 7f58affff640 1 -- 172.21.15.104:0/2563129382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b01aa2b0 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58affff640 1 --2- 172.21.15.104:0/2563129382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 0x7f58b01a9ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58a00059a0 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58a0005b00 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58a0005da0 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b01aa560 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b01af400 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f58a0007440 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.843+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f58a000fa30 con 0x7f58b011acb0 2024-09-16T16:46:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.844+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b01210f0 con 0x7f58b011acb0 2024-09-16T16:46:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.846+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f58a000fbf0 con 0x7f58b011acb0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.927+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70230068-ea94-49e2-a797-ef4f17b0c695", "id": 0} v 0) -- 0x7f58b01afed0 con 0x7f58b011acb0 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.929+0000 7f58ad7fa640 1 -- 172.21.15.104:0/2563129382 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70230068-ea94-49e2-a797-ef4f17b0c695", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f58a000fe10 con 0x7f58b011acb0 2024-09-16T16:46:52.930 INFO:teuthology.orchestra.run.smithi104.stdout:0 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 msgr2=0x7f58b01a9ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 --2- 172.21.15.104:0/2563129382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 0x7f58b01a9ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 shutdown_connections 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 --2- 172.21.15.104:0/2563129382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58b011acb0 0x7f58b01a9ba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 >> 172.21.15.104:0/2563129382 conn(0x7f58b006e9b0 msgr2=0x7f58b0118870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 shutdown_connections 2024-09-16T16:46:52.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:52.930+0000 7f58b6791640 1 -- 172.21.15.104:0/2563129382 wait complete. 2024-09-16T16:46:52.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new cbd286db-cb94-419f-b8ce-33ea74e96834 1 2024-09-16T16:46:53.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.042+0000 7f058db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f058db91640 1 Processor -- start 2024-09-16T16:46:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f058db91640 1 -- start start 2024-09-16T16:46:53.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f058db91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f058811acb0 0x7f058811b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f058db91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05881158e0 con 0x7f0588114dc0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f058db91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f0588115a70 con 0x7f058811acb0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f05877fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f058811acb0 0x7f058811b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f0586ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0588114dc0 0x7f05881151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.104:54402/0 (socket says 172.21.15.104:54402) 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f05877fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f058811acb0 0x7f058811b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51596/0 (socket says 172.21.15.104:51596) 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.049+0000 7f0586ffd640 1 -- 172.21.15.104:0/1091840861 learned_addr learned my addr 172.21.15.104:0/1091840861 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.050+0000 7f05877fe640 1 -- 172.21.15.104:0/1091840861 >> v1:172.21.15.59:6789/0 conn(0x7f0588114dc0 legacy=0x7f05881151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.050+0000 7f05877fe640 1 -- 172.21.15.104:0/1091840861 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0588115be0 con 0x7f058811acb0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.050+0000 7f05877fe640 1 --2- 172.21.15.104:0/1091840861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058811acb0 0x7f058811b0c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36142a57f3bafb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.050+0000 7f05867fc640 1 -- 172.21.15.104:0/1091840861 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f057c009d90 con 0x7f058811acb0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.050+0000 7f05867fc640 1 -- 172.21.15.104:0/1091840861 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f057c00e230 con 0x7f058811acb0 2024-09-16T16:46:53.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.050+0000 7f05867fc640 1 -- 172.21.15.104:0/1091840861 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f057c00e4d0 con 0x7f058811acb0 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 -- 172.21.15.104:0/1091840861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058811acb0 msgr2=0x7f058811b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 --2- 172.21.15.104:0/1091840861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058811acb0 0x7f058811b0c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 -- 172.21.15.104:0/1091840861 shutdown_connections 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 --2- 172.21.15.104:0/1091840861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058811acb0 0x7f058811b0c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 -- 172.21.15.104:0/1091840861 >> 172.21.15.104:0/1091840861 conn(0x7f058806e9b0 msgr2=0x7f058806edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 -- 172.21.15.104:0/1091840861 shutdown_connections 2024-09-16T16:46:53.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 1 -- 172.21.15.104:0/1091840861 wait complete. 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.051+0000 7f058db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.052+0000 7f058db91640 1 Processor -- start 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.052+0000 7f058db91640 1 -- start start 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.052+0000 7f058db91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 0x7f05881a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.052+0000 7f058db91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05881aa090 con 0x7f0588114dc0 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.053+0000 7f05877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 0x7f05881a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.053+0000 7f05877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 0x7f05881a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51600/0 (socket says 172.21.15.104:51600) 2024-09-16T16:46:53.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.053+0000 7f05877fe640 1 -- 172.21.15.104:0/2255710057 learned_addr learned my addr 172.21.15.104:0/2255710057 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:53.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.053+0000 7f05877fe640 1 -- 172.21.15.104:0/2255710057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05881aa1d0 con 0x7f0588114dc0 2024-09-16T16:46:53.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.053+0000 7f05877fe640 1 --2- 172.21.15.104:0/2255710057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 0x7f05881a9ac0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f057c014620 con 0x7f0588114dc0 2024-09-16T16:46:53.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f057c014780 con 0x7f0588114dc0 2024-09-16T16:46:53.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f057c014a20 con 0x7f0588114dc0 2024-09-16T16:46:53.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05881aa420 con 0x7f0588114dc0 2024-09-16T16:46:53.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05881af3a0 con 0x7f0588114dc0 2024-09-16T16:46:53.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f057c013400 con 0x7f0588114dc0 2024-09-16T16:46:53.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.054+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f057c019040 con 0x7f0588114dc0 2024-09-16T16:46:53.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.055+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0588120cf0 con 0x7f0588114dc0 2024-09-16T16:46:53.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.057+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f057c013890 con 0x7f0588114dc0 2024-09-16T16:46:53.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.147+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cbd286db-cb94-419f-b8ce-33ea74e96834", "id": 1} v 0) -- 0x7f0588120ed0 con 0x7f0588114dc0 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.148+0000 7f056ffff640 1 -- 172.21.15.104:0/2255710057 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cbd286db-cb94-419f-b8ce-33ea74e96834", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f057c013b00 con 0x7f0588114dc0 2024-09-16T16:46:53.149 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 msgr2=0x7f05881a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 --2- 172.21.15.104:0/2255710057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 0x7f05881a9ac0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 shutdown_connections 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 --2- 172.21.15.104:0/2255710057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0588114dc0 0x7f05881a9ac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 >> 172.21.15.104:0/2255710057 conn(0x7f058806e9b0 msgr2=0x7f0588113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 shutdown_connections 2024-09-16T16:46:53.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.149+0000 7f058db91640 1 -- 172.21.15.104:0/2255710057 wait complete. 2024-09-16T16:46:53.161 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new aeb9d5ee-8cc0-4c33-9106-f48928765e60 2 2024-09-16T16:46:53.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.261+0000 7f315ae6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.267+0000 7f315ae6c640 1 Processor -- start 2024-09-16T16:46:53.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.267+0000 7f315ae6c640 1 -- start start 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f315ae6c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f315411d970 0x7f315411fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f315ae6c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31541204a0 con 0x7f315411acb0 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f315ae6c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3154121660 con 0x7f315411d970 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f3153fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f315411d970 0x7f315411fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f3153fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f315411d970 0x7f315411fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51612/0 (socket says 172.21.15.104:51612) 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f3153fff640 1 -- 172.21.15.104:0/3127235936 learned_addr learned my addr 172.21.15.104:0/3127235936 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:53.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.268+0000 7f3158c08640 1 --1- 172.21.15.104:0/3127235936 >> v1:172.21.15.59:6789/0 conn(0x7f315411acb0 0x7f315411b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.104:54418/0 (socket says 172.21.15.104:54418) 2024-09-16T16:46:53.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.269+0000 7f3153fff640 1 -- 172.21.15.104:0/3127235936 >> v1:172.21.15.59:6789/0 conn(0x7f315411acb0 legacy=0x7f315411b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.269+0000 7f3153fff640 1 -- 172.21.15.104:0/3127235936 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31541217d0 con 0x7f315411d970 2024-09-16T16:46:53.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.269+0000 7f3153fff640 1 --2- 172.21.15.104:0/3127235936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411d970 0x7f315411fdf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdfaf088f3d0288 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.269+0000 7f31537fe640 1 -- 172.21.15.104:0/3127235936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3140009e50 con 0x7f315411d970 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.269+0000 7f31537fe640 1 -- 172.21.15.104:0/3127235936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f314000e230 con 0x7f315411d970 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.269+0000 7f31537fe640 1 -- 172.21.15.104:0/3127235936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f314000e4d0 con 0x7f315411d970 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 -- 172.21.15.104:0/3127235936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411d970 msgr2=0x7f315411fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 --2- 172.21.15.104:0/3127235936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411d970 0x7f315411fdf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 -- 172.21.15.104:0/3127235936 shutdown_connections 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 --2- 172.21.15.104:0/3127235936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411d970 0x7f315411fdf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 -- 172.21.15.104:0/3127235936 >> 172.21.15.104:0/3127235936 conn(0x7f315406e9b0 msgr2=0x7f315406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 -- 172.21.15.104:0/3127235936 shutdown_connections 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 1 -- 172.21.15.104:0/3127235936 wait complete. 2024-09-16T16:46:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.270+0000 7f315ae6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.271+0000 7f315ae6c640 1 Processor -- start 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.271+0000 7f315ae6c640 1 -- start start 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.271+0000 7f315ae6c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 0x7f31541a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.271+0000 7f315ae6c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31541aa170 con 0x7f315411acb0 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f3158c08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 0x7f31541a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f3158c08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 0x7f31541a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51620/0 (socket says 172.21.15.104:51620) 2024-09-16T16:46:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f3158c08640 1 -- 172.21.15.104:0/4080300344 learned_addr learned my addr 172.21.15.104:0/4080300344 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f3158c08640 1 -- 172.21.15.104:0/4080300344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31541aa2b0 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f3158c08640 1 --2- 172.21.15.104:0/4080300344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 0x7f31541a9ba0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f31480059a0 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3148005b00 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31541aa560 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3148005da0 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.272+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541af400 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.273+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f314800cba0 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.273+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f314800fb20 con 0x7f315411acb0 2024-09-16T16:46:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.273+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31541210f0 con 0x7f315411acb0 2024-09-16T16:46:53.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.276+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f314800fd80 con 0x7f315411acb0 2024-09-16T16:46:53.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.345+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aeb9d5ee-8cc0-4c33-9106-f48928765e60", "id": 2} v 0) -- 0x7f31541afed0 con 0x7f315411acb0 2024-09-16T16:46:53.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.347+0000 7f31517fa640 1 -- 172.21.15.104:0/4080300344 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aeb9d5ee-8cc0-4c33-9106-f48928765e60", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f314800f6e0 con 0x7f315411acb0 2024-09-16T16:46:53.347 INFO:teuthology.orchestra.run.smithi104.stdout:2 2024-09-16T16:46:53.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 msgr2=0x7f31541a9ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 --2- 172.21.15.104:0/4080300344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 0x7f31541a9ba0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 shutdown_connections 2024-09-16T16:46:53.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 --2- 172.21.15.104:0/4080300344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315411acb0 0x7f31541a9ba0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 >> 172.21.15.104:0/4080300344 conn(0x7f315406e9b0 msgr2=0x7f3154118870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 shutdown_connections 2024-09-16T16:46:53.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.348+0000 7f315ae6c640 1 -- 172.21.15.104:0/4080300344 wait complete. 2024-09-16T16:46:53.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9 3 2024-09-16T16:46:53.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.459+0000 7fc453b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.466+0000 7fc453b91640 1 Processor -- start 2024-09-16T16:46:53.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.466+0000 7fc453b91640 1 -- start start 2024-09-16T16:46:53.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.466+0000 7fc453b91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc44c11acb0 0x7fc44c11b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.466+0000 7fc453b91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c1158e0 con 0x7fc44c114dc0 2024-09-16T16:46:53.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.466+0000 7fc453b91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc44c115a70 con 0x7fc44c11acb0 2024-09-16T16:46:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45192d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc44c11acb0 0x7fc44c11b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45192d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc44c11acb0 0x7fc44c11b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51622/0 (socket says 172.21.15.104:51622) 2024-09-16T16:46:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45192d640 1 -- 172.21.15.104:0/3891654277 learned_addr learned my addr 172.21.15.104:0/3891654277 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45192d640 1 -- 172.21.15.104:0/3891654277 >> v1:172.21.15.59:6789/0 conn(0x7fc44c114dc0 legacy=0x7fc44c1151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45192d640 1 -- 172.21.15.104:0/3891654277 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c115be0 con 0x7fc44c11acb0 2024-09-16T16:46:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45192d640 1 --2- 172.21.15.104:0/3891654277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c11acb0 0x7fc44c11b0c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c76cc7384f8e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45092b640 1 -- 172.21.15.104:0/3891654277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc448009e50 con 0x7fc44c11acb0 2024-09-16T16:46:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45092b640 1 -- 172.21.15.104:0/3891654277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc44800e230 con 0x7fc44c11acb0 2024-09-16T16:46:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.467+0000 7fc45092b640 1 -- 172.21.15.104:0/3891654277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc44800e4d0 con 0x7fc44c11acb0 2024-09-16T16:46:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 -- 172.21.15.104:0/3891654277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c11acb0 msgr2=0x7fc44c11b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 --2- 172.21.15.104:0/3891654277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c11acb0 0x7fc44c11b0c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 -- 172.21.15.104:0/3891654277 shutdown_connections 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 --2- 172.21.15.104:0/3891654277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c11acb0 0x7fc44c11b0c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 -- 172.21.15.104:0/3891654277 >> 172.21.15.104:0/3891654277 conn(0x7fc44c06e9b0 msgr2=0x7fc44c06edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 -- 172.21.15.104:0/3891654277 shutdown_connections 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.468+0000 7fc453b91640 1 -- 172.21.15.104:0/3891654277 wait complete. 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.469+0000 7fc453b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.469+0000 7fc453b91640 1 Processor -- start 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.469+0000 7fc453b91640 1 -- start start 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.470+0000 7fc453b91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 0x7fc44c1a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.470+0000 7fc453b91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1aa090 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.470+0000 7fc45192d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 0x7fc44c1a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.470+0000 7fc45192d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 0x7fc44c1a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.104:51636/0 (socket says 172.21.15.104:51636) 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.470+0000 7fc45192d640 1 -- 172.21.15.104:0/1764893971 learned_addr learned my addr 172.21.15.104:0/1764893971 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.470+0000 7fc45192d640 1 -- 172.21.15.104:0/1764893971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c1aa1d0 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc45192d640 1 --2- 172.21.15.104:0/1764893971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 0x7fc44c1a9ac0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc44800eea0 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc448015420 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4480156c0 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c1aa420 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1af3a0 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fc448015c00 con 0x7fc44c114dc0 2024-09-16T16:46:53.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.471+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7fc448011830 con 0x7fc44c114dc0 2024-09-16T16:46:53.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.472+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c120cf0 con 0x7fc44c114dc0 2024-09-16T16:46:53.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.474+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fc448011380 con 0x7fc44c114dc0 2024-09-16T16:46:53.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.557+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9", "id": 3} v 0) -- 0x7fc44c120ed0 con 0x7fc44c114dc0 2024-09-16T16:46:53.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.559+0000 7fc4427fc640 1 -- 172.21.15.104:0/1764893971 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7fc448011520 con 0x7fc44c114dc0 2024-09-16T16:46:53.559 INFO:teuthology.orchestra.run.smithi104.stdout:3 2024-09-16T16:46:53.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.559+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 msgr2=0x7fc44c1a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.560+0000 7fc453b91640 1 --2- 172.21.15.104:0/1764893971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 0x7fc44c1a9ac0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.560+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 shutdown_connections 2024-09-16T16:46:53.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.560+0000 7fc453b91640 1 --2- 172.21.15.104:0/1764893971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc44c114dc0 0x7fc44c1a9ac0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.560+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 >> 172.21.15.104:0/1764893971 conn(0x7fc44c06e9b0 msgr2=0x7fc44c113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.560+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 shutdown_connections 2024-09-16T16:46:53.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-16T16:46:53.560+0000 7fc453b91640 1 -- 172.21.15.104:0/1764893971 wait complete. 2024-09-16T16:46:53.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:53.607 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T16:46:53.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:53.650 INFO:tasks.ceph.osd.0:Started 2024-09-16T16:46:53.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:53.683 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T16:46:53.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:53.726 INFO:tasks.ceph.osd.1:Started 2024-09-16T16:46:53.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:53.755 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T16:46:53.756 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:53.797 INFO:tasks.ceph.osd.2:Started 2024-09-16T16:46:53.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:53.826 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T16:46:53.826 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:53.868 INFO:tasks.ceph.osd.3:Started 2024-09-16T16:46:53.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:53.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.983+0000 7fde91d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.988+0000 7fde91d51640 1 Processor -- start 2024-09-16T16:46:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.988+0000 7fde91d51640 1 -- start start 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde91d51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde8c09ca50 0x7fde8c09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde91d51640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8c0a0060 con 0x7fde8c09d3a0 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde91d51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fde8c09fd30 con 0x7fde8c09ca50 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde8c09ca50 0x7fde8c09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8affd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde8c09d3a0 0x7fde8c135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44492/0 (socket says 172.21.15.59:44492) 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8affd640 1 -- 172.21.15.59:0/1734803617 learned_addr learned my addr 172.21.15.59:0/1734803617 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8a7fc640 1 -- 172.21.15.59:0/1734803617 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907735176 0 0) 0x7fde8c0a0060 con 0x7fde8c09d3a0 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8a7fc640 1 -- 172.21.15.59:0/1734803617 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde74003580 con 0x7fde8c09d3a0 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8b7fe640 1 -- 172.21.15.59:0/1734803617 >> v1:172.21.15.59:6789/0 conn(0x7fde8c09d3a0 legacy=0x7fde8c135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8b7fe640 1 -- 172.21.15.59:0/1734803617 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c09e3c0 con 0x7fde8c09ca50 2024-09-16T16:46:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8b7fe640 1 --2- 172.21.15.59:0/1734803617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c09ce60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3525df11be4d381 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.990+0000 7fde8a7fc640 1 -- 172.21.15.59:0/1734803617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde7c009d80 con 0x7fde8c09ca50 2024-09-16T16:46:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde8a7fc640 1 -- 172.21.15.59:0/1734803617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fde7c00e230 con 0x7fde8c09ca50 2024-09-16T16:46:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde8a7fc640 1 -- 172.21.15.59:0/1734803617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde7c00e4d0 con 0x7fde8c09ca50 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde91d51640 1 -- 172.21.15.59:0/1734803617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 msgr2=0x7fde8c09ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde91d51640 1 --2- 172.21.15.59:0/1734803617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c09ce60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde91d51640 1 -- 172.21.15.59:0/1734803617 shutdown_connections 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde91d51640 1 --2- 172.21.15.59:0/1734803617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c09ce60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.991+0000 7fde91d51640 1 -- 172.21.15.59:0/1734803617 >> 172.21.15.59:0/1734803617 conn(0x7fde8c0a5230 msgr2=0x7fde8c0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.992+0000 7fde91d51640 1 -- 172.21.15.59:0/1734803617 shutdown_connections 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.992+0000 7fde91d51640 1 -- 172.21.15.59:0/1734803617 wait complete. 2024-09-16T16:46:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.992+0000 7fde91d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.994+0000 7fde91d51640 1 Processor -- start 2024-09-16T16:46:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.994+0000 7fde91d51640 1 -- start start 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.995+0000 7fde91d51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.995+0000 7fde91d51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c125100 con 0x7fde8c09ca50 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.995+0000 7fde8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.995+0000 7fde8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c121eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57248/0 (socket says 172.21.15.59:57248) 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.995+0000 7fde8b7fe640 1 -- 172.21.15.59:0/4077687520 learned_addr learned my addr 172.21.15.59:0/4077687520 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde8b7fe640 1 -- 172.21.15.59:0/4077687520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c123930 con 0x7fde8c09ca50 2024-09-16T16:46:53.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde8b7fe640 1 --2- 172.21.15.59:0/4077687520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c121eb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde7c014410 con 0x7fde8c09ca50 2024-09-16T16:46:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fde7c014570 con 0x7fde8c09ca50 2024-09-16T16:46:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde7c014810 con 0x7fde8c09ca50 2024-09-16T16:46:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8c124df0 con 0x7fde8c09ca50 2024-09-16T16:46:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fde7c014d50 con 0x7fde8c09ca50 2024-09-16T16:46:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.996+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8c125b20 con 0x7fde8c09ca50 2024-09-16T16:46:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.997+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7fde7c019040 con 0x7fde8c09ca50 2024-09-16T16:46:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:53.997+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8c125f90 con 0x7fde8c09ca50 2024-09-16T16:46:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.000+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fde8c125f90 con 0x7fde8c09ca50 2024-09-16T16:46:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.061+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde8c1242c0 con 0x7fde8c09ca50 2024-09-16T16:46:54.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.062+0000 7fde73fff640 1 -- 172.21.15.59:0/4077687520 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7fde7c0116a0 con 0x7fde8c09ca50 2024-09-16T16:46:54.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:46:54.063 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"fsid":"c43301f4-656b-4707-8343-bef82748353c","created":"2024-09-16T16:46:51.399285+0000","modified":"2024-09-16T16:46:53.559221+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:53.559221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"70230068-ea94-49e2-a797-ef4f17b0c695","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cbd286db-cb94-419f-b8ce-33ea74e96834","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"aeb9d5ee-8cc0-4c33-9106-f48928765e60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 msgr2=0x7fde8c121eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 --2- 172.21.15.59:0/4077687520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c121eb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 shutdown_connections 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 --2- 172.21.15.59:0/4077687520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde8c09ca50 0x7fde8c121eb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 >> 172.21.15.59:0/4077687520 conn(0x7fde8c0a5230 msgr2=0x7fde8c0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 shutdown_connections 2024-09-16T16:46:54.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:46:54.063+0000 7fde91d51640 1 -- 172.21.15.59:0/4077687520 wait complete. 2024-09-16T16:46:54.074 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T16:46:54.074 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T16:46:54.478 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:54.585 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.580+0000 7fa5f4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.587 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.586+0000 7fa5f4b51640 1 Processor -- start 2024-09-16T16:46:54.587 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.587+0000 7fa5f4b51640 1 -- start start 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.588+0000 7fa5f4b51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5f00a04b0 0x7fa5f013b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.588+0000 7fa5f4b51640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00a8300 con 0x7fa5f009f990 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.588+0000 7fa5f4b51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f00a08c0 con 0x7fa5f00a04b0 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.588+0000 7fa5e7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5f00a04b0 0x7fa5f013b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.588+0000 7fa5ee59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa5f009f990 0x7fa5f009fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44496/0 (socket says 172.21.15.59:44496) 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.588+0000 7fa5ee59c640 1 -- 172.21.15.59:0/2128101138 learned_addr learned my addr 172.21.15.59:0/2128101138 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5e7fff640 1 -- 172.21.15.59:0/2128101138 >> v1:172.21.15.59:6789/0 conn(0x7fa5f009f990 legacy=0x7fa5f009fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:54.589 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5edd9b640 1 -- 172.21.15.59:0/2128101138 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898794080 0 0) 0x7fa5f00a8300 con 0x7fa5f009f990 2024-09-16T16:46:54.590 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5e7fff640 1 -- 172.21.15.59:0/2128101138 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00a14b0 con 0x7fa5f00a04b0 2024-09-16T16:46:54.590 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5e7fff640 1 --2- 172.21.15.59:0/2128101138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f00a04b0 0x7fa5f013b610 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dbb9ab2f8982be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5edd9b640 1 -- 172.21.15.59:0/2128101138 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa5d8009d90 con 0x7fa5f00a04b0 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5edd9b640 1 -- 172.21.15.59:0/2128101138 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa5d800e230 con 0x7fa5f00a04b0 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.589+0000 7fa5edd9b640 1 -- 172.21.15.59:0/2128101138 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa5d800e4d0 con 0x7fa5f00a04b0 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 -- 172.21.15.59:0/2128101138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f00a04b0 msgr2=0x7fa5f013b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 --2- 172.21.15.59:0/2128101138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f00a04b0 0x7fa5f013b610 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 -- 172.21.15.59:0/2128101138 shutdown_connections 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 --2- 172.21.15.59:0/2128101138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f00a04b0 0x7fa5f013b610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 -- 172.21.15.59:0/2128101138 >> 172.21.15.59:0/2128101138 conn(0x7fa5f00a6390 msgr2=0x7fa5f00a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:54.591 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 -- 172.21.15.59:0/2128101138 shutdown_connections 2024-09-16T16:46:54.592 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 1 -- 172.21.15.59:0/2128101138 wait complete. 2024-09-16T16:46:54.592 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.590+0000 7fa5f4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.593 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.592+0000 7fa5f4b51640 1 Processor -- start 2024-09-16T16:46:54.593 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.592+0000 7fa5f4b51640 1 -- start start 2024-09-16T16:46:54.595 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.594+0000 7fa5f4b51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 0x7fa5f01cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:54.595 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.594+0000 7fa5f4b51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f01bd210 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.594+0000 7fa5ee59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 0x7fa5f01cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.594+0000 7fa5ee59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 0x7fa5f01cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57276/0 (socket says 172.21.15.59:57276) 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.594+0000 7fa5ee59c640 1 -- 172.21.15.59:0/3667960144 learned_addr learned my addr 172.21.15.59:0/3667960144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5ee59c640 1 -- 172.21.15.59:0/3667960144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f01b8260 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5ee59c640 1 --2- 172.21.15.59:0/3667960144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 0x7fa5f01cade0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa5e0004b80 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa5e0004ce0 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f01bbed0 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa5e0007120 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f01bba80 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fa5e000c520 con 0x7fa5f009f990 2024-09-16T16:46:54.596 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.595+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7fa5e000fc00 con 0x7fa5f009f990 2024-09-16T16:46:54.597 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.596+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f01ba1a0 con 0x7fa5f009f990 2024-09-16T16:46:54.598 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.598+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fa5e000fe60 con 0x7fa5f009f990 2024-09-16T16:46:54.661 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.660+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5f0050fc0 con 0x7fa5f009f990 2024-09-16T16:46:54.661 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.661+0000 7fa5e6ffd640 1 -- 172.21.15.59:0/3667960144 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7fa5e000f230 con 0x7fa5f009f990 2024-09-16T16:46:54.661 INFO:teuthology.misc.health.smithi059.stdout: 2024-09-16T16:46:54.662 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":7,"fsid":"c43301f4-656b-4707-8343-bef82748353c","created":"2024-09-16T16:46:51.399285+0000","modified":"2024-09-16T16:46:53.559221+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:53.559221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"70230068-ea94-49e2-a797-ef4f17b0c695","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cbd286db-cb94-419f-b8ce-33ea74e96834","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"aeb9d5ee-8cc0-4c33-9106-f48928765e60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:54.662 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 msgr2=0x7fa5f01cade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:54.663 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 --2- 172.21.15.59:0/3667960144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 0x7fa5f01cade0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:54.663 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 shutdown_connections 2024-09-16T16:46:54.663 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 --2- 172.21.15.59:0/3667960144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5f009f990 0x7fa5f01cade0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:54.663 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 >> 172.21.15.59:0/3667960144 conn(0x7fa5f00a6390 msgr2=0x7fa5f0073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:54.663 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 shutdown_connections 2024-09-16T16:46:54.663 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:46:54.662+0000 7fa5f4b51640 1 -- 172.21.15.59:0/3667960144 wait complete. 2024-09-16T16:46:54.672 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T16:46:56.723 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-09-16T16:46:56.723+0000 7f1665d3b640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T16:47:01.076 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:47:01.195 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.190+0000 7f3874791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.196 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.195+0000 7f3874791640 1 Processor -- start 2024-09-16T16:47:01.196 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.195+0000 7f3874791640 1 -- start start 2024-09-16T16:47:01.198 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f3874791640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f386c073600 0x7f386c1390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.198 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f3874791640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c09dda0 con 0x7f386c072ae0 2024-09-16T16:47:01.198 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f3874791640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f386c074d70 con 0x7f386c073600 2024-09-16T16:47:01.198 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f3871d2c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f386c073600 0x7f386c1390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f3871d2c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f386c073600 0x7f386c1390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48274/0 (socket says 172.21.15.59:48274) 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f387252d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f386c072ae0 0x7f386c072ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32948/0 (socket says 172.21.15.59:32948) 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.197+0000 7f3871d2c640 1 -- 172.21.15.59:0/1812961128 learned_addr learned my addr 172.21.15.59:0/1812961128 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f3871d2c640 1 -- 172.21.15.59:0/1812961128 >> v1:172.21.15.59:6789/0 conn(0x7f386c072ae0 legacy=0x7f386c072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f3871d2c640 1 -- 172.21.15.59:0/1812961128 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c073f50 con 0x7f386c073600 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f387152b640 1 -- 172.21.15.59:0/1812961128 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422253041 0 0) 0x7f386c09dda0 con 0x7f386c072ae0 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f3871d2c640 1 --2- 172.21.15.59:0/1812961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c073600 0x7f386c1390a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebea613ba18551d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f387152b640 1 -- 172.21.15.59:0/1812961128 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f385c009e50 con 0x7f386c073600 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f387152b640 1 -- 172.21.15.59:0/1812961128 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f385c00e230 con 0x7f386c073600 2024-09-16T16:47:01.199 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.198+0000 7f387152b640 1 -- 172.21.15.59:0/1812961128 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f385c00e4d0 con 0x7f386c073600 2024-09-16T16:47:01.200 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 -- 172.21.15.59:0/1812961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c073600 msgr2=0x7f386c1390a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.200 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 --2- 172.21.15.59:0/1812961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c073600 0x7f386c1390a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.200 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 -- 172.21.15.59:0/1812961128 shutdown_connections 2024-09-16T16:47:01.200 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 --2- 172.21.15.59:0/1812961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c073600 0x7f386c1390a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.201 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 -- 172.21.15.59:0/1812961128 >> 172.21.15.59:0/1812961128 conn(0x7f386c0a7100 msgr2=0x7f386c0a31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:01.201 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 -- 172.21.15.59:0/1812961128 shutdown_connections 2024-09-16T16:47:01.201 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 1 -- 172.21.15.59:0/1812961128 wait complete. 2024-09-16T16:47:01.201 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.199+0000 7f3874791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.201 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.201+0000 7f3874791640 1 Processor -- start 2024-09-16T16:47:01.201 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.201+0000 7f3874791640 1 -- start start 2024-09-16T16:47:01.203 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3874791640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 0x7f386c122460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.203 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3874791640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f386c122010 con 0x7f386c072ae0 2024-09-16T16:47:01.203 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f387252d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 0x7f386c122460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.203 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f387252d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 0x7f386c122460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48278/0 (socket says 172.21.15.59:48278) 2024-09-16T16:47:01.203 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f387252d640 1 -- 172.21.15.59:0/1489188977 learned_addr learned my addr 172.21.15.59:0/1489188977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:01.204 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f387252d640 1 -- 172.21.15.59:0/1489188977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c123d00 con 0x7f386c072ae0 2024-09-16T16:47:01.204 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f387252d640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 0x7f386c122460 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.204 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3868004b80 con 0x7f386c072ae0 2024-09-16T16:47:01.204 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3868004ce0 con 0x7f386c072ae0 2024-09-16T16:47:01.205 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c1219d0 con 0x7f386c072ae0 2024-09-16T16:47:01.205 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3868007120 con 0x7f386c072ae0 2024-09-16T16:47:01.205 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.203+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c125940 con 0x7f386c072ae0 2024-09-16T16:47:01.205 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.204+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c0a3e70 con 0x7f386c072ae0 2024-09-16T16:47:01.205 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.205+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f38680072d0 con 0x7f386c072ae0 2024-09-16T16:47:01.205 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.205+0000 7f3862ffd640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f385003e8a0 0x7f3850040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.206 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.205+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2308+0+0 (crc 0 0 0) 0x7f386804f520 con 0x7f386c072ae0 2024-09-16T16:47:01.206 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.205+0000 7f3871d2c640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f385003e8a0 0x7f3850040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.206 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.206+0000 7f3871d2c640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f385003e8a0 0x7f3850040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.211 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.211+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f386800f230 con 0x7f386c072ae0 2024-09-16T16:47:01.402 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.401+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f386c06e0f0 con 0x7f386c072ae0 2024-09-16T16:47:01.402 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.402+0000 7f3862ffd640 1 -- 172.21.15.59:0/1489188977 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6955 (crc 0 0 0) 0x7f386800a0c0 con 0x7f386c072ae0 2024-09-16T16:47:01.403 INFO:teuthology.misc.health.smithi059.stdout: 2024-09-16T16:47:01.403 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":11,"fsid":"c43301f4-656b-4707-8343-bef82748353c","created":"2024-09-16T16:46:51.399285+0000","modified":"2024-09-16T16:47:00.736625+0000","last_up_change":"2024-09-16T16:46:59.731924+0000","last_in_change":"2024-09-16T16:46:53.559221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:59.742175+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70230068-ea94-49e2-a797-ef4f17b0c695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":3457013714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":3457013714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":3457013714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":3457013714}]},"public_addr":"172.21.15.59:6800/3457013714","cluster_addr":"172.21.15.59:6801/3457013714","heartbeat_back_addr":"172.21.15.59:6803/3457013714","heartbeat_front_addr":"172.21.15.59:6802/3457013714","state":["exists","up"]},{"osd":1,"uuid":"cbd286db-cb94-419f-b8ce-33ea74e96834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":1210870840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1210870840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1210870840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1210870840}]},"public_addr":"172.21.15.59:6811/1210870840","cluster_addr":"172.21.15.59:6810/1210870840","heartbeat_back_addr":"172.21.15.59:6809/1210870840","heartbeat_front_addr":"172.21.15.59:6808/1210870840","state":["exists","up"]},{"osd":2,"uuid":"aeb9d5ee-8cc0-4c33-9106-f48928765e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6803","nonce":2992308739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2992308739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2992308739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2992308739}]},"public_addr":"172.21.15.104:6803/2992308739","cluster_addr":"172.21.15.104:6804/2992308739","heartbeat_back_addr":"172.21.15.104:6817/2992308739","heartbeat_front_addr":"172.21.15.104:6816/2992308739","state":["exists","up"]},{"osd":3,"uuid":"1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":851587968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":851587968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":851587968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6811","nonce":851587968}]},"public_addr":"172.21.15.104:6808/851587968","cluster_addr":"172.21.15.104:6809/851587968","heartbeat_back_addr":"172.21.15.104:6810/851587968","heartbeat_front_addr":"172.21.15.104:6811/851587968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:47:01.405 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f385003e8a0 msgr2=0x7f3850040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.405 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f385003e8a0 0x7f3850040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.405 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 msgr2=0x7f386c122460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.405 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 0x7f386c122460 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.405 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 shutdown_connections 2024-09-16T16:47:01.405 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f385003e8a0 0x7f3850040db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.406 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 --2- 172.21.15.59:0/1489188977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386c072ae0 0x7f386c122460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.406 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 >> 172.21.15.59:0/1489188977 conn(0x7f386c0a7100 msgr2=0x7f386c09faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:01.406 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 shutdown_connections 2024-09-16T16:47:01.406 INFO:teuthology.misc.health.smithi059.stderr:2024-09-16T16:47:01.404+0000 7f3874791640 1 -- 172.21.15.59:0/1489188977 wait complete. 2024-09-16T16:47:01.414 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T16:47:01.414 INFO:tasks.ceph:Creating RBD pool 2024-09-16T16:47:01.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T16:47:01.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.520+0000 7f861a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.528+0000 7f861a791640 1 Processor -- start 2024-09-16T16:47:01.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.528+0000 7f861a791640 1 -- start start 2024-09-16T16:47:01.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.530+0000 7f861a791640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8614130b40 0x7f8614130f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.530+0000 7f861a791640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f861409feb0 con 0x7f8614131490 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.530+0000 7f861a791640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f861406d4d0 con 0x7f8614130b40 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.530+0000 7f8613fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8614130b40 0x7f8614130f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.530+0000 7f86137fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8614131490 0x7f8614133ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32950/0 (socket says 172.21.15.59:32950) 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.530+0000 7f86137fe640 1 -- 172.21.15.59:0/2330816962 learned_addr learned my addr 172.21.15.59:0/2330816962 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.531+0000 7f8613fff640 1 -- 172.21.15.59:0/2330816962 >> v1:172.21.15.59:6789/0 conn(0x7f8614131490 legacy=0x7f8614133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.531+0000 7f8613fff640 1 -- 172.21.15.59:0/2330816962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861409f280 con 0x7f8614130b40 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.531+0000 7f8613fff640 1 --2- 172.21.15.59:0/2330816962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f8614130f50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49fa152e5b4e175 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.531+0000 7f8612ffd640 1 -- 172.21.15.59:0/2330816962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8604009d90 con 0x7f8614130b40 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.531+0000 7f8612ffd640 1 -- 172.21.15.59:0/2330816962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f860400e230 con 0x7f8614130b40 2024-09-16T16:47:01.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.531+0000 7f8612ffd640 1 -- 172.21.15.59:0/2330816962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f860400e4d0 con 0x7f8614130b40 2024-09-16T16:47:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 -- 172.21.15.59:0/2330816962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 msgr2=0x7f8614130f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 --2- 172.21.15.59:0/2330816962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f8614130f50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 -- 172.21.15.59:0/2330816962 shutdown_connections 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 --2- 172.21.15.59:0/2330816962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f8614130f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 -- 172.21.15.59:0/2330816962 >> 172.21.15.59:0/2330816962 conn(0x7f86140a4820 msgr2=0x7f86140a63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 -- 172.21.15.59:0/2330816962 shutdown_connections 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 1 -- 172.21.15.59:0/2330816962 wait complete. 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.532+0000 7f861a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.534+0000 7f861a791640 1 Processor -- start 2024-09-16T16:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.534+0000 7f861a791640 1 -- start start 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.535+0000 7f861a791640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f86141305b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.535+0000 7f861a791640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f861411e130 con 0x7f8614130b40 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.535+0000 7f8613fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f86141305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.535+0000 7f8613fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f86141305b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48292/0 (socket says 172.21.15.59:48292) 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.535+0000 7f8613fff640 1 -- 172.21.15.59:0/82566190 learned_addr learned my addr 172.21.15.59:0/82566190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f8613fff640 1 -- 172.21.15.59:0/82566190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8614120260 con 0x7f8614130b40 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f8613fff640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f86141305b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8604014540 con 0x7f8614130b40 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f86040146a0 con 0x7f8614130b40 2024-09-16T16:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8604014940 con 0x7f8614130b40 2024-09-16T16:47:01.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86140a3100 con 0x7f8614130b40 2024-09-16T16:47:01.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.536+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861411eec0 con 0x7f8614130b40 2024-09-16T16:47:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.537+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f8604014af0 con 0x7f8614130b40 2024-09-16T16:47:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.537+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861411e8e0 con 0x7f8614130b40 2024-09-16T16:47:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.537+0000 7f8610ff9640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f860003e8a0 0x7f8600040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.537+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2308+0+0 (crc 0 0 0) 0x7f8604019040 con 0x7f8614130b40 2024-09-16T16:47:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.538+0000 7f86137fe640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f860003e8a0 0x7f8600040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.538+0000 7f86137fe640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f860003e8a0 0x7f8600040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.543+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8604018790 con 0x7f8614130b40 2024-09-16T16:47:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.730+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f861409eb90 con 0x7f8614130b40 2024-09-16T16:47:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.737+0000 7f8610ff9640 1 -- 172.21.15.59:0/82566190 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7f860400f2a0 con 0x7f8614130b40 2024-09-16T16:47:01.738 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'rbd' created 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f860003e8a0 msgr2=0x7f8600040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f860003e8a0 0x7f8600040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 msgr2=0x7f86141305b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f86141305b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 shutdown_connections 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f860003e8a0 0x7f8600040db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 --2- 172.21.15.59:0/82566190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8614130b40 0x7f86141305b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 >> 172.21.15.59:0/82566190 conn(0x7f86140a4820 msgr2=0x7f86141bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 shutdown_connections 2024-09-16T16:47:01.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.741+0000 7f861a791640 1 -- 172.21.15.59:0/82566190 wait complete. 2024-09-16T16:47:01.758 DEBUG:teuthology.orchestra.run.smithi059:> rbd --cluster ceph pool init rbd 2024-09-16T16:47:01.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.858+0000 7f508e614ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.858+0000 7f508e614ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.859+0000 7f508e614ac0 1 Processor -- start 2024-09-16T16:47:01.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.859+0000 7f508e614ac0 1 -- start start 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f508e614ac0 1 --2- >> v2:172.21.15.59:3300/0 conn(0x1a0d310 0x1a0bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f508e614ac0 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x186e180 con 0x1a0c1f0 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f508e614ac0 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x18adb90 con 0x1a0d310 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f5083fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x1a0d310 0x1a0bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f50837fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x1a0c1f0 0x1aa7620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32960/0 (socket says 172.21.15.59:32960) 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f50837fe640 1 -- 172.21.15.59:0/3853361439 learned_addr learned my addr 172.21.15.59:0/3853361439 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f5083fff640 1 -- 172.21.15.59:0/3853361439 >> v1:172.21.15.59:6789/0 conn(0x1a0c1f0 legacy=0x1aa7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f5082ffd640 1 -- 172.21.15.59:0/3853361439 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377212554 0 0) 0x186e180 con 0x1a0c1f0 2024-09-16T16:47:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.861+0000 7f5083fff640 1 -- 172.21.15.59:0/3853361439 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x1843f80 con 0x1a0d310 2024-09-16T16:47:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.863+0000 7f5083fff640 1 --2- 172.21.15.59:0/3853361439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0d310 0x1a0bcb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9c2e804ef40461 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.863+0000 7f5082ffd640 1 -- 172.21.15.59:0/3853361439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f507402d7f0 con 0x1a0d310 2024-09-16T16:47:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.863+0000 7f5082ffd640 1 -- 172.21.15.59:0/3853361439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f507402d950 con 0x1a0d310 2024-09-16T16:47:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.863+0000 7f5082ffd640 1 -- 172.21.15.59:0/3853361439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f507402dbf0 con 0x1a0d310 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 -- 172.21.15.59:0/3853361439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0d310 msgr2=0x1a0bcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 --2- 172.21.15.59:0/3853361439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0d310 0x1a0bcb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 -- 172.21.15.59:0/3853361439 shutdown_connections 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 --2- 172.21.15.59:0/3853361439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0d310 0x1a0bcb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 -- 172.21.15.59:0/3853361439 >> 172.21.15.59:0/3853361439 conn(0x1816f70 msgr2=0x1a08070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 -- 172.21.15.59:0/3853361439 shutdown_connections 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 1 -- 172.21.15.59:0/3853361439 wait complete. 2024-09-16T16:47:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.864+0000 7f508e614ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.866+0000 7f508e614ac0 1 Processor -- start 2024-09-16T16:47:01.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.866+0000 7f508e614ac0 1 -- start start 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.867+0000 7f508e614ac0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 0x1ab1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.867+0000 7f508e614ac0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x18b88f0 con 0x1a0c1f0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.867+0000 7f5083fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 0x1ab1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.867+0000 7f5083fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 0x1ab1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48318/0 (socket says 172.21.15.59:48318) 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.867+0000 7f5083fff640 1 -- 172.21.15.59:0/1250368083 learned_addr learned my addr 172.21.15.59:0/1250368083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f5083fff640 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1852800 con 0x1a0c1f0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f5083fff640 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 0x1ab1b20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5074009410 con 0x1a0c1f0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5074009570 con 0x1a0c1f0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1844310 con 0x1a0c1f0 2024-09-16T16:47:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5074009810 con 0x1a0c1f0 2024-09-16T16:47:01.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.868+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1843d70 con 0x1a0c1f0 2024-09-16T16:47:01.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.869+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f50740099c0 con 0x1a0c1f0 2024-09-16T16:47:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.869+0000 7f5073fff640 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f506803d130 0x7f506803f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.869+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7f5074032040 con 0x1a0c1f0 2024-09-16T16:47:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.870+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x1a93d60 con 0x1a0c1f0 2024-09-16T16:47:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.870+0000 7f50837fe640 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f506803d130 0x7f506803f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:01.870+0000 7f50837fe640 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f506803d130 0x7f506803f640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.749+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7f50740354c0 con 0x1a0c1f0 2024-09-16T16:47:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.749+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x186b520 con 0x1a0c1f0 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.751+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7f50740354c0 con 0x1a0c1f0 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.751+0000 7f50827fc640 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7f5060002ae0 con 0x1a0c1f0 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.752+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(13..13 src has 1..13) ==== 1028+0+0 (crc 0 0 0) 0x7f5074039d50 con 0x1a0c1f0 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.752+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6811/1210870840 conn(0x1a0d310 0x1aae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.752+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x1aaed20 con 0x1a0d310 2024-09-16T16:47:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.759+0000 7f508980e640 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6811/1210870840 conn(0x1a0d310 0x1aae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:47:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.827+0000 7f508980e640 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6811/1210870840 conn(0x1a0d310 0x1aae7e0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.852+0000 7f508980e640 1 -- 172.21.15.59:0/1250368083 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f507c00a4b0 con 0x1a0d310 2024-09-16T16:47:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.855+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6800/3457013714 conn(0x1b09270 0x1b0b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.855+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x1b0bd20 con 0x1b09270 2024-09-16T16:47:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.856+0000 7f5083fff640 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6800/3457013714 conn(0x1b09270 0x1b0b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:47:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.859+0000 7f5083fff640 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6800/3457013714 conn(0x1b09270 0x1b0b750 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.864+0000 7f5083fff640 1 -- 172.21.15.59:0/1250368083 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5074035040 con 0x1b09270 2024-09-16T16:47:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.864+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x1b08730 con 0x1b09270 2024-09-16T16:47:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.867+0000 7f5083fff640 1 -- 172.21.15.59:0/1250368083 <== osd.0 v2:172.21.15.59:6800/3457013714 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5074035040 con 0x1b09270 2024-09-16T16:47:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:02.867+0000 7f5081ffb640 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f5064001f60 con 0x1a0c1f0 2024-09-16T16:47:03.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.753+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7f5074036b90 con 0x1a0c1f0 2024-09-16T16:47:03.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.753+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f5068042860 con 0x1a0c1f0 2024-09-16T16:47:03.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.753+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 10 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7f50740363e0 con 0x1a0c1f0 2024-09-16T16:47:03.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.754+0000 7f50827fc640 1 -- 172.21.15.59:0/1250368083 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7f5060005660 con 0x1b09270 2024-09-16T16:47:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.759+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 11 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f507402fba0 con 0x1a0c1f0 2024-09-16T16:47:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.788+0000 7f5083fff640 1 -- 172.21.15.59:0/1250368083 <== osd.0 v2:172.21.15.59:6800/3457013714 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5074035040 con 0x1b09270 2024-09-16T16:47:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:03.788+0000 7f5081ffb640 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7f5064003370 con 0x1a0c1f0 2024-09-16T16:47:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.758+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7f5074035290 con 0x1a0c1f0 2024-09-16T16:47:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.758+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f5068042ce0 con 0x1a0c1f0 2024-09-16T16:47:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.759+0000 7f5073fff640 1 -- 172.21.15.59:0/1250368083 <== mon.0 v2:172.21.15.59:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7f5074030120 con 0x1a0c1f0 2024-09-16T16:47:04.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.759+0000 7f50827fc640 1 -- 172.21.15.59:0/1250368083 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f50600059c0 con 0x1b09270 2024-09-16T16:47:04.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f5083fff640 1 -- 172.21.15.59:0/1250368083 <== osd.0 v2:172.21.15.59:6800/3457013714 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5074035040 con 0x1b09270 2024-09-16T16:47:04.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6800/3457013714 conn(0x1b09270 msgr2=0x1b0b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:04.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6800/3457013714 conn(0x1b09270 0x1b0b750 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6811/1210870840 conn(0x1a0d310 msgr2=0x1aae7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6811/1210870840 conn(0x1a0d310 0x1aae7e0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f506803d130 msgr2=0x7f506803f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f506803d130 0x7f506803f640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 msgr2=0x1ab1b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 0x1ab1b20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 shutdown_connections 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6800/3457013714 conn(0x1b09270 0x1b0b750 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> v2:172.21.15.59:6811/1210870840 conn(0x1a0d310 0x1aae7e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f506803d130 0x7f506803f640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 --2- 172.21.15.59:0/1250368083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a0c1f0 0x1ab1b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 >> 172.21.15.59:0/1250368083 conn(0x1816f70 msgr2=0x1a0fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 shutdown_connections 2024-09-16T16:47:04.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.788+0000 7f508e614ac0 1 -- 172.21.15.59:0/1250368083 wait complete. 2024-09-16T16:47:04.794 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T16:47:04.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T16:47:04.795 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T16:47:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.907+0000 7fb5a7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.913+0000 7fb5a7191640 1 Processor -- start 2024-09-16T16:47:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.913+0000 7fb5a7191640 1 -- start start 2024-09-16T16:47:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.915+0000 7fb5a7191640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5a00a0590 0x7fb5a01390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.915+0000 7fb5a7191640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a0071b20 con 0x7fb5a009fa70 2024-09-16T16:47:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.915+0000 7fb5a7191640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a00a0b30 con 0x7fb5a00a0590 2024-09-16T16:47:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.915+0000 7fb59ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5a00a0590 0x7fb5a01390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.915+0000 7fb59ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5a00a0590 0x7fb5a01390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48332/0 (socket says 172.21.15.59:48332) 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.915+0000 7fb59ffff640 1 -- 172.21.15.59:0/1622276806 learned_addr learned my addr 172.21.15.59:0/1622276806 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb59ffff640 1 -- 172.21.15.59:0/1622276806 >> v1:172.21.15.59:6789/0 conn(0x7fb5a009fa70 legacy=0x7fb5a009fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb59ffff640 1 -- 172.21.15.59:0/1622276806 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a00a1a60 con 0x7fb5a00a0590 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb59ffff640 1 --2- 172.21.15.59:0/1622276806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a00a0590 0x7fb5a01390a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb039e16e91ed65 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb59f7fe640 1 -- 172.21.15.59:0/1622276806 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb594009e50 con 0x7fb5a00a0590 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb59f7fe640 1 -- 172.21.15.59:0/1622276806 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb59400e230 con 0x7fb5a00a0590 2024-09-16T16:47:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb59f7fe640 1 -- 172.21.15.59:0/1622276806 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb59400e4d0 con 0x7fb5a00a0590 2024-09-16T16:47:04.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb5a7191640 1 -- 172.21.15.59:0/1622276806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a00a0590 msgr2=0x7fb5a01390a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:04.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.916+0000 7fb5a7191640 1 --2- 172.21.15.59:0/1622276806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a00a0590 0x7fb5a01390a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.917+0000 7fb5a7191640 1 -- 172.21.15.59:0/1622276806 shutdown_connections 2024-09-16T16:47:04.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.917+0000 7fb5a7191640 1 --2- 172.21.15.59:0/1622276806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a00a0590 0x7fb5a01390a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:04.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.917+0000 7fb5a7191640 1 -- 172.21.15.59:0/1622276806 >> 172.21.15.59:0/1622276806 conn(0x7fb5a00a33b0 msgr2=0x7fb5a00a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.917+0000 7fb5a7191640 1 -- 172.21.15.59:0/1622276806 shutdown_connections 2024-09-16T16:47:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.917+0000 7fb5a7191640 1 -- 172.21.15.59:0/1622276806 wait complete. 2024-09-16T16:47:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.917+0000 7fb5a7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.919+0000 7fb5a7191640 1 Processor -- start 2024-09-16T16:47:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.919+0000 7fb5a7191640 1 -- start start 2024-09-16T16:47:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.920+0000 7fb5a7191640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 0x7fb5a01339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.920+0000 7fb5a7191640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0125d30 con 0x7fb5a009fa70 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.920+0000 7fb5a4f2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 0x7fb5a01339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.920+0000 7fb5a4f2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 0x7fb5a01339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48340/0 (socket says 172.21.15.59:48340) 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.920+0000 7fb5a4f2d640 1 -- 172.21.15.59:0/2380882711 learned_addr learned my addr 172.21.15.59:0/2380882711 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb5a4f2d640 1 -- 172.21.15.59:0/2380882711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a0124320 con 0x7fb5a009fa70 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb5a4f2d640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 0x7fb5a01339e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb59000c810 con 0x7fb5a009fa70 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb59000c970 con 0x7fb5a009fa70 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb59000cc10 con 0x7fb5a009fa70 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a0070690 con 0x7fb5a009fa70 2024-09-16T16:47:04.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.921+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a0125810 con 0x7fb5a009fa70 2024-09-16T16:47:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.922+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb590011310 con 0x7fb5a009fa70 2024-09-16T16:47:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.922+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a009fe80 con 0x7fb5a009fa70 2024-09-16T16:47:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.922+0000 7fb59d7fa640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb58c03e960 0x7fb58c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.922+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fb59004fe10 con 0x7fb5a009fa70 2024-09-16T16:47:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.923+0000 7fb59ffff640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb58c03e960 0x7fb58c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.923+0000 7fb59ffff640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb58c03e960 0x7fb58c040e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:04.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:04.928+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb59000d570 con 0x7fb5a009fa70 2024-09-16T16:47:05.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.115+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fb5a0070880 con 0x7fb5a009fa70 2024-09-16T16:47:05.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.115+0000 7fb59d7fa640 1 -- 172.21.15.59:0/2380882711 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7fb59000a120 con 0x7fb5a009fa70 2024-09-16T16:47:05.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb58c03e960 msgr2=0x7fb58c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb58c03e960 0x7fb58c040e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 msgr2=0x7fb5a01339e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 0x7fb5a01339e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 shutdown_connections 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb58c03e960 0x7fb58c040e70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 --2- 172.21.15.59:0/2380882711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5a009fa70 0x7fb5a01339e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 >> 172.21.15.59:0/2380882711 conn(0x7fb5a00a33b0 msgr2=0x7fb5a01bbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 shutdown_connections 2024-09-16T16:47:05.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.118+0000 7fb5a7191640 1 -- 172.21.15.59:0/2380882711 wait complete. 2024-09-16T16:47:05.129 INFO:teuthology.orchestra.run.smithi059.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T16:47:05.129 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T16:47:05.129 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T16:47:05.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T16:47:05.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T16:47:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.238+0000 7f8309551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.243+0000 7f8309551640 1 Processor -- start 2024-09-16T16:47:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.243+0000 7f8309551640 1 -- start start 2024-09-16T16:47:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8309551640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83040a26d0 0x7f8304131000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8309551640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8304130bb0 con 0x7f83040a2150 2024-09-16T16:47:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8309551640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f830409fb00 con 0x7f83040a26d0 2024-09-16T16:47:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8302ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83040a26d0 0x7f8304131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f83027fc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f83040a2150 0x7f8304133fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32984/0 (socket says 172.21.15.59:32984) 2024-09-16T16:47:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8302ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83040a26d0 0x7f8304131000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48342/0 (socket says 172.21.15.59:48342) 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f83027fc640 1 -- 172.21.15.59:0/606740501 learned_addr learned my addr 172.21.15.59:0/606740501 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8302ffd640 1 -- 172.21.15.59:0/606740501 >> v1:172.21.15.59:6789/0 conn(0x7f83040a2150 legacy=0x7f8304133fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8302ffd640 1 -- 172.21.15.59:0/606740501 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830409fc40 con 0x7f83040a26d0 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.245+0000 7f8301ffb640 1 -- 172.21.15.59:0/606740501 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28721478 0 0) 0x7f8304130bb0 con 0x7f83040a2150 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8302ffd640 1 --2- 172.21.15.59:0/606740501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a26d0 0x7f8304131000 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d3dd4365793f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8301ffb640 1 -- 172.21.15.59:0/606740501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f400e040 con 0x7f83040a26d0 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8301ffb640 1 -- 172.21.15.59:0/606740501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82f4007670 con 0x7f83040a26d0 2024-09-16T16:47:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8301ffb640 1 -- 172.21.15.59:0/606740501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f4007910 con 0x7f83040a26d0 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8309551640 1 -- 172.21.15.59:0/606740501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a26d0 msgr2=0x7f8304131000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8309551640 1 --2- 172.21.15.59:0/606740501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a26d0 0x7f8304131000 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8309551640 1 -- 172.21.15.59:0/606740501 shutdown_connections 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8309551640 1 --2- 172.21.15.59:0/606740501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a26d0 0x7f8304131000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.246+0000 7f8309551640 1 -- 172.21.15.59:0/606740501 >> 172.21.15.59:0/606740501 conn(0x7f83040a3310 msgr2=0x7f83040a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.247+0000 7f8309551640 1 -- 172.21.15.59:0/606740501 shutdown_connections 2024-09-16T16:47:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.247+0000 7f8309551640 1 -- 172.21.15.59:0/606740501 wait complete. 2024-09-16T16:47:05.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.247+0000 7f8309551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.249+0000 7f8309551640 1 Processor -- start 2024-09-16T16:47:05.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.249+0000 7f8309551640 1 -- start start 2024-09-16T16:47:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.250+0000 7f8309551640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 0x7f830411c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.250+0000 7f8309551640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f830411e650 con 0x7f83040a2150 2024-09-16T16:47:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.250+0000 7f8302ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 0x7f830411c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.250+0000 7f8302ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 0x7f830411c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48350/0 (socket says 172.21.15.59:48350) 2024-09-16T16:47:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.250+0000 7f8302ffd640 1 -- 172.21.15.59:0/2653581632 learned_addr learned my addr 172.21.15.59:0/2653581632 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f8302ffd640 1 -- 172.21.15.59:0/2653581632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830409f170 con 0x7f83040a2150 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f8302ffd640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 0x7f830411c8f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f400e040 con 0x7f83040a2150 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82f4013aa0 con 0x7f83040a2150 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82f4013d40 con 0x7f83040a2150 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8304074f60 con 0x7f83040a2150 2024-09-16T16:47:05.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.251+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830411fd80 con 0x7f83040a2150 2024-09-16T16:47:05.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.252+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f82f4011040 con 0x7f83040a2150 2024-09-16T16:47:05.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.252+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8304134ae0 con 0x7f83040a2150 2024-09-16T16:47:05.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.252+0000 7f82eb7fe640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f82f003e9b0 0x7f82f0040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.253+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f82f40510e0 con 0x7f83040a2150 2024-09-16T16:47:05.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.253+0000 7f83027fc640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f82f003e9b0 0x7f82f0040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.253+0000 7f83027fc640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f82f003e9b0 0x7f82f0040ec0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.258+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f82f4015580 con 0x7f83040a2150 2024-09-16T16:47:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.497+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8304050fc0 con 0x7f83040a2150 2024-09-16T16:47:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.499+0000 7f82eb7fe640 1 -- 172.21.15.59:0/2653581632 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97907 (crc 0 0 0) 0x7f82f4013ea0 con 0x7f83040a2150 2024-09-16T16:47:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:05.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.501+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f82f003e9b0 msgr2=0x7f82f0040ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f82f003e9b0 0x7f82f0040ec0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 msgr2=0x7f830411c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 0x7f830411c8f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 shutdown_connections 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f82f003e9b0 0x7f82f0040ec0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 --2- 172.21.15.59:0/2653581632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83040a2150 0x7f830411c8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 >> 172.21.15.59:0/2653581632 conn(0x7f83040a3310 msgr2=0x7f8304130dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 shutdown_connections 2024-09-16T16:47:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.502+0000 7f8309551640 1 -- 172.21.15.59:0/2653581632 wait complete. 2024-09-16T16:47:05.513 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3532556748},{"type":"v1","addr":"172.21.15.104:6801","nonce":3532556748}]},"active_addr":"172.21.15.104:6801/3532556748","active_change":"2024-09-16T16:46:55.714801+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1569640350}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1902949223}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":115606315}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1291411408}]}]} 2024-09-16T16:47:05.515 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T16:47:05.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T16:47:05.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:47:05.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.623+0000 7f7d78311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.628+0000 7f7d78311640 1 Processor -- start 2024-09-16T16:47:05.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.628+0000 7f7d78311640 1 -- start start 2024-09-16T16:47:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d78311640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d700a26d0 0x7f7d70131000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d78311640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d70130bb0 con 0x7f7d700a2150 2024-09-16T16:47:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d78311640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7d7009fb00 con 0x7f7d700a26d0 2024-09-16T16:47:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d760ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d700a26d0 0x7f7d70131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d760ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d700a26d0 0x7f7d70131000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48360/0 (socket says 172.21.15.59:48360) 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d760ad640 1 -- 172.21.15.59:0/3886259079 learned_addr learned my addr 172.21.15.59:0/3886259079 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d758ac640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d700a2150 0x7f7d70133fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32994/0 (socket says 172.21.15.59:32994) 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d760ad640 1 -- 172.21.15.59:0/3886259079 >> v1:172.21.15.59:6789/0 conn(0x7f7d700a2150 legacy=0x7f7d70133fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.630+0000 7f7d760ad640 1 -- 172.21.15.59:0/3886259079 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7009fc40 con 0x7f7d700a26d0 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.631+0000 7f7d760ad640 1 --2- 172.21.15.59:0/3886259079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a26d0 0x7f7d70131000 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf8465055c34b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.631+0000 7f7d750ab640 1 -- 172.21.15.59:0/3886259079 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d6c009e50 con 0x7f7d700a26d0 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.631+0000 7f7d750ab640 1 -- 172.21.15.59:0/3886259079 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7d6c00e230 con 0x7f7d700a26d0 2024-09-16T16:47:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.631+0000 7f7d750ab640 1 -- 172.21.15.59:0/3886259079 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d6c00e4d0 con 0x7f7d700a26d0 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 -- 172.21.15.59:0/3886259079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a26d0 msgr2=0x7f7d70131000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 --2- 172.21.15.59:0/3886259079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a26d0 0x7f7d70131000 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 -- 172.21.15.59:0/3886259079 shutdown_connections 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 --2- 172.21.15.59:0/3886259079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a26d0 0x7f7d70131000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 -- 172.21.15.59:0/3886259079 >> 172.21.15.59:0/3886259079 conn(0x7f7d700a3310 msgr2=0x7f7d700a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 -- 172.21.15.59:0/3886259079 shutdown_connections 2024-09-16T16:47:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 1 -- 172.21.15.59:0/3886259079 wait complete. 2024-09-16T16:47:05.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.632+0000 7f7d78311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.634+0000 7f7d78311640 1 Processor -- start 2024-09-16T16:47:05.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.634+0000 7f7d78311640 1 -- start start 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.635+0000 7f7d78311640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 0x7f7d701c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.635+0000 7f7d78311640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7011ce10 con 0x7f7d700a2150 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d760ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 0x7f7d701c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d760ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 0x7f7d701c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48368/0 (socket says 172.21.15.59:48368) 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d760ad640 1 -- 172.21.15.59:0/3122235551 learned_addr learned my addr 172.21.15.59:0/3122235551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d760ad640 1 -- 172.21.15.59:0/3122235551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d70133c10 con 0x7f7d700a2150 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d760ad640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 0x7f7d701c86e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d6c00ee00 con 0x7f7d700a2150 2024-09-16T16:47:05.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7d6c015420 con 0x7f7d700a2150 2024-09-16T16:47:05.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7011ca70 con 0x7f7d700a2150 2024-09-16T16:47:05.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d6c0156c0 con 0x7f7d700a2150 2024-09-16T16:47:05.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.636+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d7011fff0 con 0x7f7d700a2150 2024-09-16T16:47:05.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.637+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d70134ae0 con 0x7f7d700a2150 2024-09-16T16:47:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.637+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7d6c015870 con 0x7f7d700a2150 2024-09-16T16:47:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.638+0000 7f7d66ffd640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f7d5403e930 0x7f7d54040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.638+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f7d6c050d40 con 0x7f7d700a2150 2024-09-16T16:47:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.638+0000 7f7d758ac640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f7d5403e930 0x7f7d54040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.639+0000 7f7d758ac640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f7d5403e930 0x7f7d54040e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.643+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f7d6c012c00 con 0x7f7d700a2150 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.829+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d70050fc0 con 0x7f7d700a2150 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.830+0000 7f7d66ffd640 1 -- 172.21.15.59:0/3122235551 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8876 (crc 0 0 0) 0x7f7d6c012330 con 0x7f7d700a2150 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":15,"fsid":"c43301f4-656b-4707-8343-bef82748353c","created":"2024-09-16T16:46:51.399285+0000","modified":"2024-09-16T16:47:04.755357+0000","last_up_change":"2024-09-16T16:46:59.731924+0000","last_in_change":"2024-09-16T16:46:53.559221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:59.742175+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:47:01.733857+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70230068-ea94-49e2-a797-ef4f17b0c695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":3457013714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":3457013714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":3457013714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":3457013714}]},"public_addr":"172.21.15.59:6800/3457013714","cluster_addr":"172.21.15.59:6801/3457013714","heartbeat_back_addr":"172.21.15.59:6803/3457013714","heartbeat_front_addr":"172.21.15.59:6802/3457013714","state":["exists","up"]},{"osd":1,"uuid":"cbd286db-cb94-419f-b8ce-33ea74e96834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":1210870840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1210870840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1210870840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1210870840}]},"public_addr":"172.21.15.59:6811/1210870840","cluster_addr":"172.21.15.59:6810/1210870840","heartbeat_back_addr":"172.21.15.59:6809/1210870840","heartbeat_front_addr":"172.21.15.59:6808/1210870840","state":["exists","up"]},{"osd":2,"uuid":"aeb9d5ee-8cc0-4c33-9106-f48928765e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6803","nonce":2992308739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2992308739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2992308739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2992308739}]},"public_addr":"172.21.15.104:6803/2992308739","cluster_addr":"172.21.15.104:6804/2992308739","heartbeat_back_addr":"172.21.15.104:6817/2992308739","heartbeat_front_addr":"172.21.15.104:6816/2992308739","state":["exists","up"]},{"osd":3,"uuid":"1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":851587968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":851587968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":851587968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6811","nonce":851587968}]},"public_addr":"172.21.15.104:6808/851587968","cluster_addr":"172.21.15.104:6809/851587968","heartbeat_back_addr":"172.21.15.104:6810/851587968","heartbeat_front_addr":"172.21.15.104:6811/851587968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f7d5403e930 msgr2=0x7f7d54040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f7d5403e930 0x7f7d54040e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 msgr2=0x7f7d701c86e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 0x7f7d701c86e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 shutdown_connections 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f7d5403e930 0x7f7d54040e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 --2- 172.21.15.59:0/3122235551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d700a2150 0x7f7d701c86e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 >> 172.21.15.59:0/3122235551 conn(0x7f7d700a3310 msgr2=0x7f7d700a40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 shutdown_connections 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.832+0000 7f7d78311640 1 -- 172.21.15.59:0/3122235551 wait complete. 2024-09-16T16:47:05.843 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T16:47:05.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:47:05.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.953+0000 7fc97a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.958+0000 7fc97a991640 1 Processor -- start 2024-09-16T16:47:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.958+0000 7fc97a991640 1 -- start start 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc97a991640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc97409d570 0x7fc97413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc97a991640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9740a0060 con 0x7fc97409ca50 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc97a991640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc97409fd30 con 0x7fc97409d570 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc9737fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc97409d570 0x7fc97413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc9737fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc97409d570 0x7fc97413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48380/0 (socket says 172.21.15.59:48380) 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc9737fe640 1 -- 172.21.15.59:0/1144434519 learned_addr learned my addr 172.21.15.59:0/1144434519 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc973fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc97409ca50 0x7fc97409ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33002/0 (socket says 172.21.15.59:33002) 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc9737fe640 1 -- 172.21.15.59:0/1144434519 >> v1:172.21.15.59:6789/0 conn(0x7fc97409ca50 legacy=0x7fc97409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc9737fe640 1 -- 172.21.15.59:0/1144434519 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97409e3c0 con 0x7fc97409d570 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc972ffd640 1 -- 172.21.15.59:0/1144434519 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487590597 0 0) 0x7fc9740a0060 con 0x7fc97409ca50 2024-09-16T16:47:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc9737fe640 1 --2- 172.21.15.59:0/1144434519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409d570 0x7fc97413b3b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6666c950348c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc972ffd640 1 -- 172.21.15.59:0/1144434519 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc968009e40 con 0x7fc97409d570 2024-09-16T16:47:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc972ffd640 1 -- 172.21.15.59:0/1144434519 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc96800e230 con 0x7fc97409d570 2024-09-16T16:47:05.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.960+0000 7fc972ffd640 1 -- 172.21.15.59:0/1144434519 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc96800e4d0 con 0x7fc97409d570 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 -- 172.21.15.59:0/1144434519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409d570 msgr2=0x7fc97413b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 --2- 172.21.15.59:0/1144434519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409d570 0x7fc97413b3b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 -- 172.21.15.59:0/1144434519 shutdown_connections 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 --2- 172.21.15.59:0/1144434519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409d570 0x7fc97413b3b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 -- 172.21.15.59:0/1144434519 >> 172.21.15.59:0/1144434519 conn(0x7fc9740a5230 msgr2=0x7fc9740a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 -- 172.21.15.59:0/1144434519 shutdown_connections 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 1 -- 172.21.15.59:0/1144434519 wait complete. 2024-09-16T16:47:05.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.961+0000 7fc97a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.963+0000 7fc97a991640 1 Processor -- start 2024-09-16T16:47:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.963+0000 7fc97a991640 1 -- start start 2024-09-16T16:47:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.965+0000 7fc97a991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 0x7fc974126b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.965+0000 7fc97a991640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc974136db0 con 0x7fc97409ca50 2024-09-16T16:47:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.965+0000 7fc973fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 0x7fc974126b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.965+0000 7fc973fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 0x7fc974126b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48386/0 (socket says 172.21.15.59:48386) 2024-09-16T16:47:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.965+0000 7fc973fff640 1 -- 172.21.15.59:0/1893303973 learned_addr learned my addr 172.21.15.59:0/1893303973 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.965+0000 7fc973fff640 1 -- 172.21.15.59:0/1893303973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc974125450 con 0x7fc97409ca50 2024-09-16T16:47:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.966+0000 7fc973fff640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 0x7fc974126b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.966+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc964004b80 con 0x7fc97409ca50 2024-09-16T16:47:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.966+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc964004ce0 con 0x7fc97409ca50 2024-09-16T16:47:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.966+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc964007120 con 0x7fc97409ca50 2024-09-16T16:47:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.966+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc974124ba0 con 0x7fc97409ca50 2024-09-16T16:47:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.966+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc974126270 con 0x7fc97409ca50 2024-09-16T16:47:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.967+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9740a1ba0 con 0x7fc97409ca50 2024-09-16T16:47:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.967+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc9640072d0 con 0x7fc97409ca50 2024-09-16T16:47:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.967+0000 7fc970ff9640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc96003e930 0x7fc960040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.967+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fc96404f7e0 con 0x7fc97409ca50 2024-09-16T16:47:05.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.968+0000 7fc9737fe640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc96003e930 0x7fc960040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:05.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.968+0000 7fc9737fe640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc96003e930 0x7fc960040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:05.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:05.972+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc96400f230 con 0x7fc97409ca50 2024-09-16T16:47:06.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.157+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc97409ce60 con 0x7fc97409ca50 2024-09-16T16:47:06.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.158+0000 7fc970ff9640 1 -- 172.21.15.59:0/1893303973 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8876 (crc 0 0 0) 0x7fc964006740 con 0x7fc97409ca50 2024-09-16T16:47:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:06.159 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":15,"fsid":"c43301f4-656b-4707-8343-bef82748353c","created":"2024-09-16T16:46:51.399285+0000","modified":"2024-09-16T16:47:04.755357+0000","last_up_change":"2024-09-16T16:46:59.731924+0000","last_in_change":"2024-09-16T16:46:53.559221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:59.742175+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:47:01.733857+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70230068-ea94-49e2-a797-ef4f17b0c695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":3457013714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":3457013714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":3457013714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":3457013714}]},"public_addr":"172.21.15.59:6800/3457013714","cluster_addr":"172.21.15.59:6801/3457013714","heartbeat_back_addr":"172.21.15.59:6803/3457013714","heartbeat_front_addr":"172.21.15.59:6802/3457013714","state":["exists","up"]},{"osd":1,"uuid":"cbd286db-cb94-419f-b8ce-33ea74e96834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":1210870840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1210870840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1210870840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1210870840}]},"public_addr":"172.21.15.59:6811/1210870840","cluster_addr":"172.21.15.59:6810/1210870840","heartbeat_back_addr":"172.21.15.59:6809/1210870840","heartbeat_front_addr":"172.21.15.59:6808/1210870840","state":["exists","up"]},{"osd":2,"uuid":"aeb9d5ee-8cc0-4c33-9106-f48928765e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6803","nonce":2992308739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2992308739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2992308739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2992308739}]},"public_addr":"172.21.15.104:6803/2992308739","cluster_addr":"172.21.15.104:6804/2992308739","heartbeat_back_addr":"172.21.15.104:6817/2992308739","heartbeat_front_addr":"172.21.15.104:6816/2992308739","state":["exists","up"]},{"osd":3,"uuid":"1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":851587968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":851587968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":851587968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6811","nonce":851587968}]},"public_addr":"172.21.15.104:6808/851587968","cluster_addr":"172.21.15.104:6809/851587968","heartbeat_back_addr":"172.21.15.104:6810/851587968","heartbeat_front_addr":"172.21.15.104:6811/851587968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc96003e930 msgr2=0x7fc960040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc96003e930 0x7fc960040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 msgr2=0x7fc974126b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 0x7fc974126b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 shutdown_connections 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc96003e930 0x7fc960040e40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 --2- 172.21.15.59:0/1893303973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc97409ca50 0x7fc974126b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 >> 172.21.15.59:0/1893303973 conn(0x7fc9740a5230 msgr2=0x7fc9740a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 shutdown_connections 2024-09-16T16:47:06.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.160+0000 7fc97a991640 1 -- 172.21.15.59:0/1893303973 wait complete. 2024-09-16T16:47:06.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T16:47:06.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T16:47:06.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T16:47:06.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T16:47:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.292+0000 7f3c82391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.292+0000 7f21e9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.292+0000 7fe270908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.292+0000 7f39f0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7f3c82391640 1 Processor -- start 2024-09-16T16:47:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7f39f0391640 1 Processor -- start 2024-09-16T16:47:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7f3c82391640 1 -- start start 2024-09-16T16:47:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7f39f0391640 1 -- start start 2024-09-16T16:47:06.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7fe270908640 1 Processor -- start 2024-09-16T16:47:06.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7fe270908640 1 -- start start 2024-09-16T16:47:06.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.299+0000 7f21e9d91640 1 Processor -- start 2024-09-16T16:47:06.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.300+0000 7f21e9d91640 1 -- start start 2024-09-16T16:47:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c82391640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c7c1360f0 0x7f3c7c136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c82391640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c7c0a5c40 con 0x7f3c7c09e170 2024-09-16T16:47:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f39f0391640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39e809db00 0x7f39e809df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c82391640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3c7c0a6010 con 0x7f3c7c1360f0 2024-09-16T16:47:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c7bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c7c1360f0 0x7f3c7c136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f39f0391640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e809ed40 con 0x7f39e809e450 2024-09-16T16:47:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f39f0391640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f39e80a0700 con 0x7f39e809db00 2024-09-16T16:47:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c7b7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c7c09e170 0x7f3c7c09e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33010/0 (socket says 172.21.15.59:33010) 2024-09-16T16:47:06.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c7b7fe640 1 -- 172.21.15.59:0/2022879786 learned_addr learned my addr 172.21.15.59:0/2022879786 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f39ee12d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39e809db00 0x7f39e809df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f39ee12d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39e809db00 0x7f39e809df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48396/0 (socket says 172.21.15.59:48396) 2024-09-16T16:47:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f39ee12d640 1 -- 172.21.15.59:0/1981566532 learned_addr learned my addr 172.21.15.59:0/1981566532 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.301+0000 7f3c7bfff640 1 -- 172.21.15.59:0/2022879786 >> v1:172.21.15.59:6789/0 conn(0x7f3c7c09e170 legacy=0x7f3c7c09e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f3c7bfff640 1 -- 172.21.15.59:0/2022879786 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c09f510 con 0x7f3c7c1360f0 2024-09-16T16:47:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f39ee12d640 1 -- 172.21.15.59:0/1981566532 >> v1:172.21.15.59:6789/0 conn(0x7f39e809e450 legacy=0x7f39e8138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f39ee12d640 1 -- 172.21.15.59:0/1981566532 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e809fbd0 con 0x7f39e809db00 2024-09-16T16:47:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f39ee12d640 1 --2- 172.21.15.59:0/1981566532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e809df10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ac8765a12a7af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f3c7bfff640 1 --2- 172.21.15.59:0/2022879786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c1360f0 0x7f3c7c136500 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa581acfd332aa66 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f39ed12b640 1 -- 172.21.15.59:0/1981566532 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e4009e40 con 0x7f39e809db00 2024-09-16T16:47:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f39ed12b640 1 -- 172.21.15.59:0/1981566532 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39e400e230 con 0x7f39e809db00 2024-09-16T16:47:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f39ed12b640 1 -- 172.21.15.59:0/1981566532 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e400e4d0 con 0x7f39e809db00 2024-09-16T16:47:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f3c7affd640 1 -- 172.21.15.59:0/2022879786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c6c009d90 con 0x7f3c7c1360f0 2024-09-16T16:47:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f21e9d91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21e4138fd0 0x7f21e413b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7fe270908640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe26c09d570 0x7fe26c13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f3c7affd640 1 -- 172.21.15.59:0/2022879786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c6c00e230 con 0x7f3c7c1360f0 2024-09-16T16:47:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7fe270908640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe26c0a0060 con 0x7fe26c09ca50 2024-09-16T16:47:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7fe270908640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe26c09fd30 con 0x7fe26c09d570 2024-09-16T16:47:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f3c7affd640 1 -- 172.21.15.59:0/2022879786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c6c00e4d0 con 0x7f3c7c1360f0 2024-09-16T16:47:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f21e9d91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e4136c10 con 0x7f21e41360f0 2024-09-16T16:47:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7f21e9d91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f21e40a6010 con 0x7f21e4138fd0 2024-09-16T16:47:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.302+0000 7fe269d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe26c09d570 0x7fe26c13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e37fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f21e41360f0 0x7f21e4136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33028/0 (socket says 172.21.15.59:33028) 2024-09-16T16:47:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e2ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21e4138fd0 0x7f21e413b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e37fe640 1 -- 172.21.15.59:0/1025892534 learned_addr learned my addr 172.21.15.59:0/1025892534 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7fe269d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe26c09d570 0x7fe26c13b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48408/0 (socket says 172.21.15.59:48408) 2024-09-16T16:47:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7fe269d9b640 1 -- 172.21.15.59:0/2352919304 learned_addr learned my addr 172.21.15.59:0/2352919304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e2ffd640 1 -- 172.21.15.59:0/1025892534 >> v1:172.21.15.59:6789/0 conn(0x7f21e41360f0 legacy=0x7f21e4136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e2ffd640 1 -- 172.21.15.59:0/1025892534 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e40a5c40 con 0x7f21e4138fd0 2024-09-16T16:47:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7fe269d9b640 1 -- 172.21.15.59:0/2352919304 >> v1:172.21.15.59:6789/0 conn(0x7fe26c09ca50 legacy=0x7fe26c09ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7fe269d9b640 1 -- 172.21.15.59:0/2352919304 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c09e3c0 con 0x7fe26c09d570 2024-09-16T16:47:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e2ffd640 1 --2- 172.21.15.59:0/1025892534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4138fd0 0x7f21e413b3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a266a29376f4f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7fe269d9b640 1 --2- 172.21.15.59:0/2352919304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09d570 0x7fe26c13b3b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad1fe91f5fc615 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f39f0391640 1 -- 172.21.15.59:0/1981566532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 msgr2=0x7f39e809df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f3c82391640 1 -- 172.21.15.59:0/2022879786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c1360f0 msgr2=0x7f3c7c136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f3c82391640 1 --2- 172.21.15.59:0/2022879786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c1360f0 0x7f3c7c136500 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f39f0391640 1 --2- 172.21.15.59:0/1981566532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e809df10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f21e27fc640 1 -- 172.21.15.59:0/1025892534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21d8009d90 con 0x7f21e4138fd0 2024-09-16T16:47:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f3c82391640 1 -- 172.21.15.59:0/2022879786 shutdown_connections 2024-09-16T16:47:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f3c82391640 1 --2- 172.21.15.59:0/2022879786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c1360f0 0x7f3c7c136500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f3c82391640 1 -- 172.21.15.59:0/2022879786 >> 172.21.15.59:0/2022879786 conn(0x7f3c7c06f850 msgr2=0x7f3c7c09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f39f0391640 1 -- 172.21.15.59:0/1981566532 shutdown_connections 2024-09-16T16:47:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.303+0000 7f39f0391640 1 --2- 172.21.15.59:0/1981566532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e809df10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f39f0391640 1 -- 172.21.15.59:0/1981566532 >> 172.21.15.59:0/1981566532 conn(0x7f39e80a45b0 msgr2=0x7f39e80a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f3c82391640 1 -- 172.21.15.59:0/2022879786 shutdown_connections 2024-09-16T16:47:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f21e27fc640 1 -- 172.21.15.59:0/1025892534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f21d800e230 con 0x7f21e4138fd0 2024-09-16T16:47:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f21e27fc640 1 -- 172.21.15.59:0/1025892534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21d800e4d0 con 0x7f21e4138fd0 2024-09-16T16:47:06.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f3c82391640 1 -- 172.21.15.59:0/2022879786 wait complete. 2024-09-16T16:47:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f39f0391640 1 -- 172.21.15.59:0/1981566532 shutdown_connections 2024-09-16T16:47:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7fe26959a640 1 -- 172.21.15.59:0/2352919304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe260009e40 con 0x7fe26c09d570 2024-09-16T16:47:06.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f39f0391640 1 -- 172.21.15.59:0/1981566532 wait complete. 2024-09-16T16:47:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7fe26959a640 1 -- 172.21.15.59:0/2352919304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe26000e230 con 0x7fe26c09d570 2024-09-16T16:47:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7fe26959a640 1 -- 172.21.15.59:0/2352919304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe26000e4d0 con 0x7fe26c09d570 2024-09-16T16:47:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f3c82391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.304+0000 7f39f0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 -- 172.21.15.59:0/1025892534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4138fd0 msgr2=0x7f21e413b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 --2- 172.21.15.59:0/1025892534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4138fd0 0x7f21e413b3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 -- 172.21.15.59:0/1025892534 shutdown_connections 2024-09-16T16:47:06.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 -- 172.21.15.59:0/2352919304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09d570 msgr2=0x7fe26c13b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 --2- 172.21.15.59:0/1025892534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4138fd0 0x7f21e413b3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 --2- 172.21.15.59:0/2352919304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09d570 0x7fe26c13b3b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 -- 172.21.15.59:0/1025892534 >> 172.21.15.59:0/1025892534 conn(0x7f21e406f850 msgr2=0x7f21e409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 -- 172.21.15.59:0/1025892534 shutdown_connections 2024-09-16T16:47:06.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 1 -- 172.21.15.59:0/1025892534 wait complete. 2024-09-16T16:47:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 -- 172.21.15.59:0/2352919304 shutdown_connections 2024-09-16T16:47:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 --2- 172.21.15.59:0/2352919304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09d570 0x7fe26c13b3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 -- 172.21.15.59:0/2352919304 >> 172.21.15.59:0/2352919304 conn(0x7fe26c0a5230 msgr2=0x7fe26c0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 -- 172.21.15.59:0/2352919304 shutdown_connections 2024-09-16T16:47:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7fe270908640 1 -- 172.21.15.59:0/2352919304 wait complete. 2024-09-16T16:47:06.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.305+0000 7f21e9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.306+0000 7fe270908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.306+0000 7f39f0391640 1 Processor -- start 2024-09-16T16:47:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.306+0000 7f39f0391640 1 -- start start 2024-09-16T16:47:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.306+0000 7f3c82391640 1 Processor -- start 2024-09-16T16:47:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.307+0000 7f3c82391640 1 -- start start 2024-09-16T16:47:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f39f0391640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e81b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f39f0391640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39e806fcf0 con 0x7f39e809db00 2024-09-16T16:47:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f39ee12d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e81b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f39ee12d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e81b84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48428/0 (socket says 172.21.15.59:48428) 2024-09-16T16:47:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f39ee12d640 1 -- 172.21.15.59:0/706785600 learned_addr learned my addr 172.21.15.59:0/706785600 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f3c82391640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 0x7f3c7c1250c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f39ee12d640 1 -- 172.21.15.59:0/706785600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e81b95e0 con 0x7f39e809db00 2024-09-16T16:47:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f3c82391640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c1272d0 con 0x7f3c7c09e170 2024-09-16T16:47:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f3c7bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 0x7f3c7c1250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f21e9d91640 1 Processor -- start 2024-09-16T16:47:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.308+0000 7f3c7bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 0x7f3c7c1250c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48432/0 (socket says 172.21.15.59:48432) 2024-09-16T16:47:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f3c7bfff640 1 -- 172.21.15.59:0/2519240156 learned_addr learned my addr 172.21.15.59:0/2519240156 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f39ee12d640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e81b84a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7fe270908640 1 Processor -- start 2024-09-16T16:47:06.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f21e9d91640 1 -- start start 2024-09-16T16:47:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e400ee10 con 0x7f39e809db00 2024-09-16T16:47:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39e4015420 con 0x7f39e809db00 2024-09-16T16:47:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e40156c0 con 0x7f39e809db00 2024-09-16T16:47:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f3c7bfff640 1 -- 172.21.15.59:0/2519240156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c126a10 con 0x7f3c7c09e170 2024-09-16T16:47:06.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f3c7bfff640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 0x7f3c7c1250c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e81b99f0 con 0x7f39e809db00 2024-09-16T16:47:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7fe270908640 1 -- start start 2024-09-16T16:47:06.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.309+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e81b8190 con 0x7f39e809db00 2024-09-16T16:47:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.310+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c6c014620 con 0x7f3c7c09e170 2024-09-16T16:47:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.310+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7c128380 con 0x7f3c7c09e170 2024-09-16T16:47:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.310+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7c128b20 con 0x7f3c7c09e170 2024-09-16T16:47:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.310+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c6c014780 con 0x7f3c7c09e170 2024-09-16T16:47:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.310+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c6c014a20 con 0x7f3c7c09e170 2024-09-16T16:47:06.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.310+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39e80a28c0 con 0x7f39e809db00 2024-09-16T16:47:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c5c000f80 con 0x7f3c7c09e170 2024-09-16T16:47:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f39e4015870 con 0x7f39e809db00 2024-09-16T16:47:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3c6c014bd0 con 0x7f3c7c09e170 2024-09-16T16:47:06.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f21e9d91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 0x7f21e41228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7fe270908640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 0x7fe26c124450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7fe270908640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c123b00 con 0x7fe26c09ca50 2024-09-16T16:47:06.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f39deffd640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f39cc03e960 0x7f39cc040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f21e9d91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41242e0 con 0x7f21e41360f0 2024-09-16T16:47:06.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.311+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f39e4050cc0 con 0x7f39e809db00 2024-09-16T16:47:06.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f21e37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 0x7f21e41228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f21e37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 0x7f21e41228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48450/0 (socket says 172.21.15.59:48450) 2024-09-16T16:47:06.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7fe26a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 0x7fe26c124450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f21e37fe640 1 -- 172.21.15.59:0/1911477743 learned_addr learned my addr 172.21.15.59:0/1911477743 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f39deffd640 1 --2- 172.21.15.59:0/706785600 >> v2:172.21.15.104:6808/851587968 conn(0x7f39cc043960 0x7f39cc045e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 --> v2:172.21.15.104:6808/851587968 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39cc0464c0 con 0x7f39cc043960 2024-09-16T16:47:06.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f39e4051010 con 0x7f39e809db00 2024-09-16T16:47:06.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f3c78ff9640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f3c6803e910 0x7f3c68040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7fe26a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 0x7fe26c124450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48448/0 (socket says 172.21.15.59:48448) 2024-09-16T16:47:06.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7fe26a59c640 1 -- 172.21.15.59:0/1538614701 learned_addr learned my addr 172.21.15.59:0/1538614701 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f3c6c019040 con 0x7f3c7c09e170 2024-09-16T16:47:06.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f3c78ff9640 1 --2- 172.21.15.59:0/2519240156 >> v2:172.21.15.59:6800/3457013714 conn(0x7f3c68043910 0x7f3c68045de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 --> v2:172.21.15.59:6800/3457013714 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c68046470 con 0x7f3c68043910 2024-09-16T16:47:06.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f3c6c053510 con 0x7f3c7c09e170 2024-09-16T16:47:06.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f3c7b7fe640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f3c6803e910 0x7f3c68040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f39ed92c640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f39cc03e960 0x7f39cc040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f21e37fe640 1 -- 172.21.15.59:0/1911477743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e4123a70 con 0x7f21e41360f0 2024-09-16T16:47:06.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7fe26a59c640 1 -- 172.21.15.59:0/1538614701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c124090 con 0x7fe26c09ca50 2024-09-16T16:47:06.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f21e37fe640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 0x7f21e41228e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.312+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21d4005a60 con 0x7f21e41360f0 2024-09-16T16:47:06.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f3c7b7fe640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f3c6803e910 0x7f3c68040e20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f21d4005bc0 con 0x7f21e41360f0 2024-09-16T16:47:06.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f21e9d91640 1 -- 172.21.15.59:0/1911477743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e4124b90 con 0x7f21e41360f0 2024-09-16T16:47:06.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f39ed92c640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f39cc03e960 0x7f39cc040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21d4005e60 con 0x7f21e41360f0 2024-09-16T16:47:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f21e9d91640 1 -- 172.21.15.59:0/1911477743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e41252a0 con 0x7f21e41360f0 2024-09-16T16:47:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7fe26a59c640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 0x7fe26c124450 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f39ee92e640 1 --2- 172.21.15.59:0/706785600 >> v2:172.21.15.104:6808/851587968 conn(0x7f39cc043960 0x7f39cc045e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:47:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.313+0000 7f3c8092e640 1 --2- 172.21.15.59:0/2519240156 >> v2:172.21.15.59:6800/3457013714 conn(0x7f3c68043910 0x7f3c68045de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:47:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe25c00c890 con 0x7fe26c09ca50 2024-09-16T16:47:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe25c00c9f0 con 0x7fe26c09ca50 2024-09-16T16:47:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe25c00cc90 con 0x7fe26c09ca50 2024-09-16T16:47:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c125d60 con 0x7fe26c09ca50 2024-09-16T16:47:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f21d400c7f0 con 0x7f21e41360f0 2024-09-16T16:47:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7f21e9d91640 1 -- 172.21.15.59:0/1911477743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21e409f5d0 con 0x7f21e41360f0 2024-09-16T16:47:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.314+0000 7f21cbfff640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f21d003e980 0x7f21d0040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c126c90 con 0x7fe26c09ca50 2024-09-16T16:47:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7f21e2ffd640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f21d003e980 0x7f21d0040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f21d404f5f0 con 0x7f21e41360f0 2024-09-16T16:47:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7f21cbfff640 1 --2- 172.21.15.59:0/1911477743 >> v2:172.21.15.59:6811/1210870840 conn(0x7f21d0043980 0x7f21d0045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 --> v2:172.21.15.59:6811/1210870840 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21d00464e0 con 0x7f21d0043980 2024-09-16T16:47:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7f21e2ffd640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f21d003e980 0x7f21d0040e90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.315+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f21d400f230 con 0x7f21e41360f0 2024-09-16T16:47:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.316+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe26c123e90 con 0x7fe26c09ca50 2024-09-16T16:47:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.316+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe25c011310 con 0x7fe26c09ca50 2024-09-16T16:47:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.316+0000 7fe25affd640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe24c03e980 0x7fe24c040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7f21e3fff640 1 --2- 172.21.15.59:0/1911477743 >> v2:172.21.15.59:6811/1210870840 conn(0x7f21d0043980 0x7f21d0045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:47:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fe25c04fed0 con 0x7fe26c09ca50 2024-09-16T16:47:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7f39ee92e640 1 --2- 172.21.15.59:0/706785600 >> v2:172.21.15.104:6808/851587968 conn(0x7f39cc043960 0x7f39cc045e30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7fe269d9b640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe24c03e980 0x7fe24c040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7fe25affd640 1 --2- 172.21.15.59:0/1538614701 >> v2:172.21.15.104:6803/2992308739 conn(0x7fe24c043980 0x7fe24c045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 --> v2:172.21.15.104:6803/2992308739 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe24c0464e0 con 0x7fe24c043980 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7fe25c052290 con 0x7fe26c09ca50 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.317+0000 7fe269d9b640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe24c03e980 0x7fe24c040e90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.318+0000 7fe26ad9d640 1 --2- 172.21.15.59:0/1538614701 >> v2:172.21.15.104:6803/2992308739 conn(0x7fe24c043980 0x7fe24c045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.319+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f39cc0464c0 con 0x7f39cc043960 2024-09-16T16:47:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.319+0000 7f3c8092e640 1 --2- 172.21.15.59:0/2519240156 >> v2:172.21.15.59:6800/3457013714 conn(0x7f3c68043910 0x7f3c68045de0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.321+0000 7f21e3fff640 1 --2- 172.21.15.59:0/1911477743 >> v2:172.21.15.59:6811/1210870840 conn(0x7f21d0043980 0x7f21d0045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.321+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f3c68046470 con 0x7f3c68043910 2024-09-16T16:47:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.323+0000 7fe26ad9d640 1 --2- 172.21.15.59:0/1538614701 >> v2:172.21.15.104:6803/2992308739 conn(0x7fe24c043980 0x7fe24c045e50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.323+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f21d00464e0 con 0x7f21d0043980 2024-09-16T16:47:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.323+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 --> v2:172.21.15.104:6808/851587968 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39e80a02d0 con 0x7f39cc043960 2024-09-16T16:47:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== osd.2 v2:172.21.15.104:6803/2992308739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fe24c0464e0 con 0x7fe24c043980 2024-09-16T16:47:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39deffd640 1 -- 172.21.15.59:0/706785600 <== osd.3 v2:172.21.15.104:6808/851587968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f39e000a820 con 0x7f39cc043960 2024-09-16T16:47:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 >> v2:172.21.15.104:6808/851587968 conn(0x7f39cc043960 msgr2=0x7f39cc045e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 --2- 172.21.15.59:0/706785600 >> v2:172.21.15.104:6808/851587968 conn(0x7f39cc043960 0x7f39cc045e30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f39cc03e960 msgr2=0x7f39cc040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f39cc03e960 0x7f39cc040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 msgr2=0x7f39e81b84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e81b84a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 --> v2:172.21.15.59:6800/3457013714 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c5c002c30 con 0x7f3c68043910 2024-09-16T16:47:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 shutdown_connections 2024-09-16T16:47:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 --2- 172.21.15.59:0/706785600 >> v2:172.21.15.104:6808/851587968 conn(0x7f39cc043960 0x7f39cc045e30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f39cc03e960 0x7f39cc040e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 --2- 172.21.15.59:0/706785600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39e809db00 0x7f39e81b84a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.325+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 >> 172.21.15.59:0/706785600 conn(0x7f39e80a45b0 msgr2=0x7f39e80a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.327+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 shutdown_connections 2024-09-16T16:47:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.327+0000 7f39f0391640 1 -- 172.21.15.59:0/706785600 wait complete. 2024-09-16T16:47:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.327+0000 7f3c78ff9640 1 -- 172.21.15.59:0/2519240156 <== osd.0 v2:172.21.15.59:6800/3457013714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3c5c002c30 con 0x7f3c68043910 2024-09-16T16:47:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f21e9d91640 1 -- 172.21.15.59:0/1911477743 --> v2:172.21.15.59:6811/1210870840 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21e4139220 con 0x7f21d0043980 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 >> v2:172.21.15.59:6800/3457013714 conn(0x7f3c68043910 msgr2=0x7f3c68045de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 --2- 172.21.15.59:0/2519240156 >> v2:172.21.15.59:6800/3457013714 conn(0x7f3c68043910 0x7f3c68045de0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f3c6803e910 msgr2=0x7f3c68040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f3c6803e910 0x7f3c68040e20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 msgr2=0x7f3c7c1250c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 0x7f3c7c1250c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 shutdown_connections 2024-09-16T16:47:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 --2- 172.21.15.59:0/2519240156 >> v2:172.21.15.59:6800/3457013714 conn(0x7f3c68043910 0x7f3c68045de0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f3c6803e910 0x7f3c68040e20 crc :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 --2- 172.21.15.59:0/2519240156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7c09e170 0x7f3c7c1250c0 crc :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 >> 172.21.15.59:0/2519240156 conn(0x7f3c7c06f850 msgr2=0x7f3c7c0a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 shutdown_connections 2024-09-16T16:47:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.328+0000 7f3c82391640 1 -- 172.21.15.59:0/2519240156 wait complete. 2024-09-16T16:47:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.330+0000 7f21cbfff640 1 -- 172.21.15.59:0/1911477743 <== osd.1 v2:172.21.15.59:6811/1210870840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f21e4139220 con 0x7f21d0043980 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 >> v2:172.21.15.59:6811/1210870840 conn(0x7f21d0043980 msgr2=0x7f21d0045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 --2- 172.21.15.59:0/1911477743 >> v2:172.21.15.59:6811/1210870840 conn(0x7f21d0043980 0x7f21d0045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f21d003e980 msgr2=0x7f21d0040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f21d003e980 0x7f21d0040e90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 msgr2=0x7f21e41228e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 0x7f21e41228e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 shutdown_connections 2024-09-16T16:47:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 --2- 172.21.15.59:0/1911477743 >> v2:172.21.15.59:6811/1210870840 conn(0x7f21d0043980 0x7f21d0045e50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f21d003e980 0x7f21d0040e90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 --2- 172.21.15.59:0/1911477743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41360f0 0x7f21e41228e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 >> 172.21.15.59:0/1911477743 conn(0x7f21e406f850 msgr2=0x7f21e409df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 --> v2:172.21.15.104:6803/2992308739 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe26c09f9b0 con 0x7fe24c043980 2024-09-16T16:47:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 shutdown_connections 2024-09-16T16:47:06.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.331+0000 7f21c9ffb640 1 -- 172.21.15.59:0/1911477743 wait complete. 2024-09-16T16:47:06.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe25affd640 1 -- 172.21.15.59:0/1538614701 <== osd.2 v2:172.21.15.104:6803/2992308739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe26400a820 con 0x7fe24c043980 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 >> v2:172.21.15.104:6803/2992308739 conn(0x7fe24c043980 msgr2=0x7fe24c045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe270908640 1 --2- 172.21.15.59:0/1538614701 >> v2:172.21.15.104:6803/2992308739 conn(0x7fe24c043980 0x7fe24c045e50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe24c03e980 msgr2=0x7fe24c040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe270908640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe24c03e980 0x7fe24c040e90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 msgr2=0x7fe26c124450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.333+0000 7fe270908640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 0x7fe26c124450 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 shutdown_connections 2024-09-16T16:47:06.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 --2- 172.21.15.59:0/1538614701 >> v2:172.21.15.104:6803/2992308739 conn(0x7fe24c043980 0x7fe24c045e50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe24c03e980 0x7fe24c040e90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 --2- 172.21.15.59:0/1538614701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe26c09ca50 0x7fe26c124450 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 >> 172.21.15.59:0/1538614701 conn(0x7fe26c0a5230 msgr2=0x7fe26c0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 shutdown_connections 2024-09-16T16:47:06.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.334+0000 7fe270908640 1 -- 172.21.15.59:0/1538614701 wait complete. 2024-09-16T16:47:06.358 INFO:teuthology.orchestra.run.smithi059.stdout:38654705671 2024-09-16T16:47:06.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T16:47:06.359 INFO:teuthology.orchestra.run.smithi059.stdout:38654705671 2024-09-16T16:47:06.359 INFO:teuthology.orchestra.run.smithi059.stdout:38654705671 2024-09-16T16:47:06.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T16:47:06.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T16:47:06.361 INFO:teuthology.orchestra.run.smithi059.stdout:42949672966 2024-09-16T16:47:06.361 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T16:47:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.520+0000 7f103f274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.520+0000 7efecc111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.520+0000 7f764ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.520+0000 7fbab3688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.526+0000 7f764ff91640 1 Processor -- start 2024-09-16T16:47:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.526+0000 7efecc111640 1 Processor -- start 2024-09-16T16:47:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.526+0000 7f103f274640 1 Processor -- start 2024-09-16T16:47:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.526+0000 7fbab3688640 1 Processor -- start 2024-09-16T16:47:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.527+0000 7f764ff91640 1 -- start start 2024-09-16T16:47:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.527+0000 7fbab3688640 1 -- start start 2024-09-16T16:47:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.527+0000 7f103f274640 1 -- start start 2024-09-16T16:47:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.527+0000 7efecc111640 1 -- start start 2024-09-16T16:47:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7fbab3688640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaac09ca50 0x7fbaac09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7fbab3688640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaac0a0060 con 0x7fbaac09d3a0 2024-09-16T16:47:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7fbab3688640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbaac09fd30 con 0x7fbaac09ca50 2024-09-16T16:47:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7f764ff91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7648134770 0x7f76481391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7fbab1424640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaac09ca50 0x7fbaac09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7f764ff91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76480a2590 con 0x7f7648133c50 2024-09-16T16:47:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.528+0000 7f764dd2d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7648133c50 0x7f7648134060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33058/0 (socket says 172.21.15.59:33058) 2024-09-16T16:47:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764dd2d640 1 -- 172.21.15.59:0/3024971045 learned_addr learned my addr 172.21.15.59:0/3024971045 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764ff91640 1 -- 172.21.15.59:0/3024971045 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f76480a2c00 con 0x7f7648134770 2024-09-16T16:47:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764d52c640 1 --2- 172.21.15.59:0/3024971045 >> v2:172.21.15.59:3300/0 conn(0x7f7648134770 0x7f76481391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbab1424640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaac09ca50 0x7fbaac09ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48466/0 (socket says 172.21.15.59:48466) 2024-09-16T16:47:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbab1424640 1 -- 172.21.15.59:0/2205633410 learned_addr learned my addr 172.21.15.59:0/2205633410 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbab1424640 1 -- 172.21.15.59:0/2205633410 >> v1:172.21.15.59:6789/0 conn(0x7fbaac09d3a0 legacy=0x7fbaac135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbab1424640 1 -- 172.21.15.59:0/2205633410 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac09e3c0 con 0x7fbaac09ca50 2024-09-16T16:47:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764cd2b640 1 -- 172.21.15.59:0/3024971045 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890057829 0 0) 0x7f76480a2590 con 0x7f7648133c50 2024-09-16T16:47:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764cd2b640 1 -- 172.21.15.59:0/3024971045 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7634003580 con 0x7f7648133c50 2024-09-16T16:47:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbab1424640 1 --2- 172.21.15.59:0/2205633410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac09ce60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f45b25e746db59c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbaa3fff640 1 -- 172.21.15.59:0/2205633410 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa8009e40 con 0x7fbaac09ca50 2024-09-16T16:47:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbaa3fff640 1 -- 172.21.15.59:0/2205633410 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaa800e230 con 0x7fbaac09ca50 2024-09-16T16:47:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7fbaa3fff640 1 -- 172.21.15.59:0/2205633410 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa800e4d0 con 0x7fbaac09ca50 2024-09-16T16:47:06.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764d52c640 1 -- 172.21.15.59:0/3024971045 >> v1:172.21.15.59:6789/0 conn(0x7f7648133c50 legacy=0x7f7648134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.529+0000 7f764d52c640 1 -- 172.21.15.59:0/3024971045 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764809dfb0 con 0x7f7648134770 2024-09-16T16:47:06.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f764d52c640 1 --2- 172.21.15.59:0/3024971045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648134770 0x7f76481391e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc0ad23324c9d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f764cd2b640 1 -- 172.21.15.59:0/3024971045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7638009d90 con 0x7f7648134770 2024-09-16T16:47:06.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f103f274640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1038138fd0 0x7f103813b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f103d010640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f10381360f0 0x7f1038136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33066/0 (socket says 172.21.15.59:33066) 2024-09-16T16:47:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f764cd2b640 1 -- 172.21.15.59:0/3024971045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f763800e230 con 0x7f7648134770 2024-09-16T16:47:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f103d010640 1 -- 172.21.15.59:0/2463806520 learned_addr learned my addr 172.21.15.59:0/2463806520 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1038136c10 con 0x7f10381360f0 2024-09-16T16:47:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f10380a6010 con 0x7f1038138fd0 2024-09-16T16:47:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f764cd2b640 1 -- 172.21.15.59:0/3024971045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f763800e4d0 con 0x7f7648134770 2024-09-16T16:47:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7efecc111640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efec41360f0 0x7efec4136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7f103c80f640 1 --2- 172.21.15.59:0/2463806520 >> v2:172.21.15.59:3300/0 conn(0x7f1038138fd0 0x7f103813b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7efec9ead640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efec41360f0 0x7efec4136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7efec96ac640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efec409e170 0x7efec409e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33076/0 (socket says 172.21.15.59:33076) 2024-09-16T16:47:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7efec96ac640 1 -- 172.21.15.59:0/3070679988 learned_addr learned my addr 172.21.15.59:0/3070679988 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec40a5c40 con 0x7efec409e170 2024-09-16T16:47:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.530+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efec40a6010 con 0x7efec41360f0 2024-09-16T16:47:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7efec8eab640 1 -- 172.21.15.59:0/3070679988 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541340423 0 0) 0x7efec40a5c40 con 0x7efec409e170 2024-09-16T16:47:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7efec8eab640 1 -- 172.21.15.59:0/3070679988 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb0003580 con 0x7efec409e170 2024-09-16T16:47:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7fbab3688640 1 -- 172.21.15.59:0/2205633410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 msgr2=0x7fbaac09ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7fbab3688640 1 --2- 172.21.15.59:0/2205633410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac09ce60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7efec9ead640 1 -- 172.21.15.59:0/3070679988 >> v1:172.21.15.59:6789/0 conn(0x7efec409e170 legacy=0x7efec409e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f102ffff640 1 -- 172.21.15.59:0/2463806520 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460046615 0 0) 0x7f1034001110 con 0x7f10381360f0 2024-09-16T16:47:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f102ffff640 1 -- 172.21.15.59:0/2463806520 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1024003580 con 0x7f10381360f0 2024-09-16T16:47:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7efec9ead640 1 -- 172.21.15.59:0/3070679988 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec409f510 con 0x7efec41360f0 2024-09-16T16:47:06.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f103c80f640 1 -- 172.21.15.59:0/2463806520 >> v1:172.21.15.59:6789/0 conn(0x7f10381360f0 legacy=0x7f1038136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f103c80f640 1 -- 172.21.15.59:0/2463806520 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10380a5c40 con 0x7f1038138fd0 2024-09-16T16:47:06.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7efec9ead640 1 --2- 172.21.15.59:0/3070679988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec41360f0 0x7efec4136500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fed2834f6484c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7fbab3688640 1 -- 172.21.15.59:0/2205633410 shutdown_connections 2024-09-16T16:47:06.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f764ff91640 1 -- 172.21.15.59:0/3024971045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648134770 msgr2=0x7f76481391e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7fbab3688640 1 --2- 172.21.15.59:0/2205633410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac09ce60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7fbab3688640 1 -- 172.21.15.59:0/2205633410 >> 172.21.15.59:0/2205633410 conn(0x7fbaac0a5230 msgr2=0x7fbaac0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f764ff91640 1 --2- 172.21.15.59:0/3024971045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648134770 0x7f76481391e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7efec8eab640 1 -- 172.21.15.59:0/3070679988 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efec0009d90 con 0x7efec41360f0 2024-09-16T16:47:06.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f103c80f640 1 --2- 172.21.15.59:0/2463806520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038138fd0 0x7f103813b3f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a9a2743b2ca734 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f764ff91640 1 -- 172.21.15.59:0/3024971045 shutdown_connections 2024-09-16T16:47:06.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f764ff91640 1 --2- 172.21.15.59:0/3024971045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648134770 0x7f76481391e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7f764ff91640 1 -- 172.21.15.59:0/3024971045 >> 172.21.15.59:0/3024971045 conn(0x7f76480a3050 msgr2=0x7f76480a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.531+0000 7fbab3688640 1 -- 172.21.15.59:0/2205633410 shutdown_connections 2024-09-16T16:47:06.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7fbab3688640 1 -- 172.21.15.59:0/2205633410 wait complete. 2024-09-16T16:47:06.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7f764ff91640 1 -- 172.21.15.59:0/3024971045 shutdown_connections 2024-09-16T16:47:06.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7efec8eab640 1 -- 172.21.15.59:0/3070679988 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efec000e230 con 0x7efec41360f0 2024-09-16T16:47:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7efec8eab640 1 -- 172.21.15.59:0/3070679988 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efec000e4d0 con 0x7efec41360f0 2024-09-16T16:47:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7f102ffff640 1 -- 172.21.15.59:0/2463806520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1028009d90 con 0x7f1038138fd0 2024-09-16T16:47:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7f764ff91640 1 -- 172.21.15.59:0/3024971045 wait complete. 2024-09-16T16:47:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7f102ffff640 1 -- 172.21.15.59:0/2463806520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f102800e230 con 0x7f1038138fd0 2024-09-16T16:47:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7f102ffff640 1 -- 172.21.15.59:0/2463806520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f102800e4d0 con 0x7f1038138fd0 2024-09-16T16:47:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7fbab3688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.532+0000 7f764ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038138fd0 msgr2=0x7f103813b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 --2- 172.21.15.59:0/2463806520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038138fd0 0x7f103813b3f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 shutdown_connections 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 --2- 172.21.15.59:0/2463806520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1038138fd0 0x7f103813b3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec41360f0 msgr2=0x7efec4136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 --2- 172.21.15.59:0/3070679988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec41360f0 0x7efec4136500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 >> 172.21.15.59:0/2463806520 conn(0x7f103806f850 msgr2=0x7f103809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 shutdown_connections 2024-09-16T16:47:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 --2- 172.21.15.59:0/3070679988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec41360f0 0x7efec4136500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 >> 172.21.15.59:0/3070679988 conn(0x7efec406f850 msgr2=0x7efec409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 shutdown_connections 2024-09-16T16:47:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 1 -- 172.21.15.59:0/2463806520 wait complete. 2024-09-16T16:47:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 shutdown_connections 2024-09-16T16:47:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7efecc111640 1 -- 172.21.15.59:0/3070679988 wait complete. 2024-09-16T16:47:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.533+0000 7f103f274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.534+0000 7efecc111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.534+0000 7fbab3688640 1 Processor -- start 2024-09-16T16:47:06.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.534+0000 7f764ff91640 1 Processor -- start 2024-09-16T16:47:06.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.534+0000 7fbab3688640 1 -- start start 2024-09-16T16:47:06.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.534+0000 7f764ff91640 1 -- start start 2024-09-16T16:47:06.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.535+0000 7f103f274640 1 Processor -- start 2024-09-16T16:47:06.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.535+0000 7f103f274640 1 -- start start 2024-09-16T16:47:06.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7fbab3688640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7fbab3688640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac136da0 con 0x7fbaac09ca50 2024-09-16T16:47:06.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7efecc111640 1 Processor -- start 2024-09-16T16:47:06.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7fbab1424640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7efecc111640 1 -- start start 2024-09-16T16:47:06.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7fbab1424640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48490/0 (socket says 172.21.15.59:48490) 2024-09-16T16:47:06.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.536+0000 7fbab1424640 1 -- 172.21.15.59:0/4023413456 learned_addr learned my addr 172.21.15.59:0/4023413456 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f764ff91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 0x7f76481c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f764dd2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 0x7f76481c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f764dd2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 0x7f76481c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48504/0 (socket says 172.21.15.59:48504) 2024-09-16T16:47:06.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f764dd2d640 1 -- 172.21.15.59:0/1666904329 learned_addr learned my addr 172.21.15.59:0/1666904329 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7fbab1424640 1 -- 172.21.15.59:0/4023413456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac126cf0 con 0x7fbaac09ca50 2024-09-16T16:47:06.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76481205c0 con 0x7f7648133c50 2024-09-16T16:47:06.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7fbab1424640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac122d10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f103f274640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 0x7f10381ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa800ed90 con 0x7fbaac09ca50 2024-09-16T16:47:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f103f274640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1038125670 con 0x7f10381360f0 2024-09-16T16:47:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaa8015420 con 0x7fbaac09ca50 2024-09-16T16:47:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa80156c0 con 0x7fbaac09ca50 2024-09-16T16:47:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f764dd2d640 1 -- 172.21.15.59:0/1666904329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76481229b0 con 0x7f7648133c50 2024-09-16T16:47:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac136a70 con 0x7fbaac09ca50 2024-09-16T16:47:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f103d010640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 0x7f10381ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f103d010640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 0x7f10381ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48510/0 (socket says 172.21.15.59:48510) 2024-09-16T16:47:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.537+0000 7f103d010640 1 -- 172.21.15.59:0/1749706024 learned_addr learned my addr 172.21.15.59:0/1749706024 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f764dd2d640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 0x7f76481c8690 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac0a3830 con 0x7fbaac09ca50 2024-09-16T16:47:06.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7644005a60 con 0x7f7648133c50 2024-09-16T16:47:06.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7644005bc0 con 0x7f7648133c50 2024-09-16T16:47:06.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f103d010640 1 -- 172.21.15.59:0/1749706024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1038121a20 con 0x7f10381360f0 2024-09-16T16:47:06.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7644005e60 con 0x7f7648133c50 2024-09-16T16:47:06.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7648122000 con 0x7f7648133c50 2024-09-16T16:47:06.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.538+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7648124110 con 0x7f7648133c50 2024-09-16T16:47:06.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7efecc111640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 0x7efec41209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7f103d010640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 0x7f10381ca950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7efecc111640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efec4122cb0 con 0x7efec409e170 2024-09-16T16:47:06.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7efec9ead640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 0x7efec41209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1034005930 con 0x7f10381360f0 2024-09-16T16:47:06.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1034005a90 con 0x7f10381360f0 2024-09-16T16:47:06.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1034005d30 con 0x7f10381360f0 2024-09-16T16:47:06.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaac124fc0 con 0x7fbaac09ca50 2024-09-16T16:47:06.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7efec9ead640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 0x7efec41209c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48526/0 (socket says 172.21.15.59:48526) 2024-09-16T16:47:06.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7efec9ead640 1 -- 172.21.15.59:0/3031879727 learned_addr learned my addr 172.21.15.59:0/3031879727 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10381230f0 con 0x7f10381360f0 2024-09-16T16:47:06.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.539+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbaa8015870 con 0x7fbaac09ca50 2024-09-16T16:47:06.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381239a0 con 0x7f10381360f0 2024-09-16T16:47:06.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7efec9ead640 1 -- 172.21.15.59:0/3031879727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec41249d0 con 0x7efec409e170 2024-09-16T16:47:06.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7efec9ead640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 0x7efec41209c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f76440070b0 con 0x7f7648133c50 2024-09-16T16:47:06.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7648134060 con 0x7f7648133c50 2024-09-16T16:47:06.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7fbaa1ffb640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fba9003e930 0x7fba90040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fbaa8050d20 con 0x7fbaac09ca50 2024-09-16T16:47:06.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7fbab0c23640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fba9003e930 0x7fba90040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.540+0000 7f763e7fc640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f762c03e930 0x7f762c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f764404f770 con 0x7f7648133c50 2024-09-16T16:47:06.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10380a0340 con 0x7f10381360f0 2024-09-16T16:47:06.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f764d52c640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f762c03e930 0x7f762c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f103400c800 con 0x7f10381360f0 2024-09-16T16:47:06.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7fbab0c23640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fba9003e930 0x7fba90040e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f764d52c640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f762c03e930 0x7f762c040e40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f102dffb640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f101c03e9b0 0x7f101c040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.541+0000 7f103c80f640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f101c03e9b0 0x7f101c040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.542+0000 7f103c80f640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f101c03e9b0 0x7f101c040ec0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.546+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efec0013400 con 0x7efec409e170 2024-09-16T16:47:06.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.546+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f103400d9b0 con 0x7f10381360f0 2024-09-16T16:47:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.546+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbaa8014c10 con 0x7fbaac09ca50 2024-09-16T16:47:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.546+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec4121d70 con 0x7efec409e170 2024-09-16T16:47:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.546+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec4122400 con 0x7efec409e170 2024-09-16T16:47:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.547+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec40a10e0 con 0x7efec409e170 2024-09-16T16:47:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.557+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f764400dc60 con 0x7f7648133c50 2024-09-16T16:47:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.567+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f103400f230 con 0x7f10381360f0 2024-09-16T16:47:06.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.567+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efec00093c0 con 0x7efec409e170 2024-09-16T16:47:06.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.568+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efec0013690 con 0x7efec409e170 2024-09-16T16:47:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.568+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efec00137f0 con 0x7efec409e170 2024-09-16T16:47:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.568+0000 7efeba7fc640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803e8e0 0x7efea8040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.568+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7efec0018040 con 0x7efec409e170 2024-09-16T16:47:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.569+0000 7efec96ac640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803e8e0 0x7efea8040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.570+0000 7efec96ac640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803e8e0 0x7efea8040df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.578+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7efec0012cc0 con 0x7efec409e170 2024-09-16T16:47:06.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.744+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7648050fc0 con 0x7f7648133c50 2024-09-16T16:47:06.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.744+0000 7f763e7fc640 1 -- 172.21.15.59:0/1666904329 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f764400d660 con 0x7f7648133c50 2024-09-16T16:47:06.745 INFO:teuthology.orchestra.run.smithi059.stdout:38654705671 2024-09-16T16:47:06.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f762c03e930 msgr2=0x7f762c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f762c03e930 0x7f762c040e40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 msgr2=0x7f76481c8690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 0x7f76481c8690 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 shutdown_connections 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f762c03e930 0x7f762c040e40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 --2- 172.21.15.59:0/1666904329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7648133c50 0x7f76481c8690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 >> 172.21.15.59:0/1666904329 conn(0x7f76480a3050 msgr2=0x7f7648072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 shutdown_connections 2024-09-16T16:47:06.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.748+0000 7f764ff91640 1 -- 172.21.15.59:0/1666904329 wait complete. 2024-09-16T16:47:06.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.750+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbaac09ce60 con 0x7fbaac09ca50 2024-09-16T16:47:06.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.750+0000 7fbaa1ffb640 1 -- 172.21.15.59:0/4023413456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fbaa8010310 con 0x7fbaac09ca50 2024-09-16T16:47:06.750 INFO:teuthology.orchestra.run.smithi059.stdout:42949672966 2024-09-16T16:47:06.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1038136c10 con 0x7f10381360f0 2024-09-16T16:47:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fba9003e930 msgr2=0x7fba90040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fba9003e930 0x7fba90040e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 msgr2=0x7fbaac122d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac122d10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 shutdown_connections 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fba9003e930 0x7fba90040e40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 --2- 172.21.15.59:0/4023413456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaac09ca50 0x7fbaac122d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.753+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 >> 172.21.15.59:0/4023413456 conn(0x7fbaac0a5230 msgr2=0x7fbaac0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.754+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 shutdown_connections 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.754+0000 7fbab3688640 1 -- 172.21.15.59:0/4023413456 wait complete. 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.754+0000 7f102dffb640 1 -- 172.21.15.59:0/1749706024 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f1038136c10 con 0x7f10381360f0 2024-09-16T16:47:06.755 INFO:teuthology.orchestra.run.smithi059.stdout:38654705671 2024-09-16T16:47:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f101c03e9b0 msgr2=0x7f101c040ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f101c03e9b0 0x7f101c040ec0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 msgr2=0x7f10381ca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 0x7f10381ca950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 shutdown_connections 2024-09-16T16:47:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f101c03e9b0 0x7f101c040ec0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 --2- 172.21.15.59:0/1749706024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10381360f0 0x7f10381ca950 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 >> 172.21.15.59:0/1749706024 conn(0x7f103806f850 msgr2=0x7f10381be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 shutdown_connections 2024-09-16T16:47:06.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.757+0000 7f103f274640 1 -- 172.21.15.59:0/1749706024 wait complete. 2024-09-16T16:47:06.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-16T16:47:06.761 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:06.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-09-16T16:47:06.770 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:06.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2024-09-16T16:47:06.772 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:06.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.778+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efec4050fc0 con 0x7efec409e170 2024-09-16T16:47:06.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.778+0000 7efeba7fc640 1 -- 172.21.15.59:0/3031879727 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7efec0019270 con 0x7efec409e170 2024-09-16T16:47:06.779 INFO:teuthology.orchestra.run.smithi059.stdout:38654705671 2024-09-16T16:47:06.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803e8e0 msgr2=0x7efea8040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803e8e0 0x7efea8040df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 msgr2=0x7efec41209c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 0x7efec41209c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 shutdown_connections 2024-09-16T16:47:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803e8e0 0x7efea8040df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 --2- 172.21.15.59:0/3031879727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec409e170 0x7efec41209c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.780+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 >> 172.21.15.59:0/3031879727 conn(0x7efec406f850 msgr2=0x7efec40a42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.781+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 shutdown_connections 2024-09-16T16:47:06.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.781+0000 7efecc111640 1 -- 172.21.15.59:0/3031879727 wait complete. 2024-09-16T16:47:06.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-16T16:47:06.792 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:06.792 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:47:06.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:06.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.941+0000 7f1ffe646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.946+0000 7f1ffe646640 1 Processor -- start 2024-09-16T16:47:06.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.946+0000 7f1ffe646640 1 -- start start 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.947+0000 7f1ffe646640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ff809ca50 0x7f1ff809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.947+0000 7f1ffe646640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff80a0060 con 0x7f1ff809d3a0 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.947+0000 7f1ffe646640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff809fd30 con 0x7f1ff809ca50 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ff809ca50 0x7f1ff809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff77fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1ff809d3a0 0x7f1ff8135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33080/0 (socket says 172.21.15.59:33080) 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ff809ca50 0x7f1ff809ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48530/0 (socket says 172.21.15.59:48530) 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff77fe640 1 -- 172.21.15.59:0/1526745552 learned_addr learned my addr 172.21.15.59:0/1526745552 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff7fff640 1 -- 172.21.15.59:0/1526745552 >> v1:172.21.15.59:6789/0 conn(0x7f1ff809d3a0 legacy=0x7f1ff8135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff7fff640 1 -- 172.21.15.59:0/1526745552 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff809e3c0 con 0x7f1ff809ca50 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff7fff640 1 --2- 172.21.15.59:0/1526745552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff809ce60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98af6955e5d26f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff6ffd640 1 -- 172.21.15.59:0/1526745552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fe8009d80 con 0x7f1ff809ca50 2024-09-16T16:47:06.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff6ffd640 1 -- 172.21.15.59:0/1526745552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1fe800e230 con 0x7f1ff809ca50 2024-09-16T16:47:06.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.948+0000 7f1ff6ffd640 1 -- 172.21.15.59:0/1526745552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fe800e4d0 con 0x7f1ff809ca50 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.949+0000 7f1ffe646640 1 -- 172.21.15.59:0/1526745552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 msgr2=0x7f1ff809ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.949+0000 7f1ffe646640 1 --2- 172.21.15.59:0/1526745552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff809ce60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.949+0000 7f1ffe646640 1 -- 172.21.15.59:0/1526745552 shutdown_connections 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.949+0000 7f1ffe646640 1 --2- 172.21.15.59:0/1526745552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff809ce60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.949+0000 7f1ffe646640 1 -- 172.21.15.59:0/1526745552 >> 172.21.15.59:0/1526745552 conn(0x7f1ff80a5230 msgr2=0x7f1ff80a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.950+0000 7f1ffe646640 1 -- 172.21.15.59:0/1526745552 shutdown_connections 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.950+0000 7f1ffe646640 1 -- 172.21.15.59:0/1526745552 wait complete. 2024-09-16T16:47:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.950+0000 7f1ffe646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.952+0000 7f1ffe646640 1 Processor -- start 2024-09-16T16:47:06.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.952+0000 7f1ffe646640 1 -- start start 2024-09-16T16:47:06.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.953+0000 7f1ffe646640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff8122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.953+0000 7f1ffe646640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff8136da0 con 0x7f1ff809ca50 2024-09-16T16:47:06.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.953+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff8122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.953+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff8122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48536/0 (socket says 172.21.15.59:48536) 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.953+0000 7f1ff7fff640 1 -- 172.21.15.59:0/895791276 learned_addr learned my addr 172.21.15.59:0/895791276 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ff7fff640 1 -- 172.21.15.59:0/895791276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff8126cf0 con 0x7f1ff809ca50 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ff7fff640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff8122d10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fe8014540 con 0x7f1ff809ca50 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1fe80146a0 con 0x7f1ff809ca50 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fe8014940 con 0x7f1ff809ca50 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff8136a70 con 0x7f1ff809ca50 2024-09-16T16:47:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.954+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff80a3830 con 0x7f1ff809ca50 2024-09-16T16:47:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.955+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1fe8014d00 con 0x7f1ff809ca50 2024-09-16T16:47:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.955+0000 7f1ff4ff9640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f1fe403e980 0x7f1fe4040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.955+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff8124fc0 con 0x7f1ff809ca50 2024-09-16T16:47:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.955+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1fe8019040 con 0x7f1ff809ca50 2024-09-16T16:47:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.956+0000 7f1ff77fe640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f1fe403e980 0x7f1fe4040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.956+0000 7f1ff77fe640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f1fe403e980 0x7f1fe4040e90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:06.961+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1fe8012580 con 0x7f1ff809ca50 2024-09-16T16:47:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.146+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ff80a1fc0 con 0x7f1fe403e980 2024-09-16T16:47:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.148+0000 7f1ff4ff9640 1 -- 172.21.15.59:0/895791276 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31131 (crc 0 0 0) 0x7f1ff80a1fc0 con 0x7f1fe403e980 2024-09-16T16:47:07.148 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f1fe403e980 msgr2=0x7f1fe4040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f1fe403e980 0x7f1fe4040e90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 msgr2=0x7f1ff8122d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff8122d10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 shutdown_connections 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f1fe403e980 0x7f1fe4040e90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 --2- 172.21.15.59:0/895791276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ff809ca50 0x7f1ff8122d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 >> 172.21.15.59:0/895791276 conn(0x7f1ff80a5230 msgr2=0x7f1ff80a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 shutdown_connections 2024-09-16T16:47:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.150+0000 7f1ffe646640 1 -- 172.21.15.59:0/895791276 wait complete. 2024-09-16T16:47:07.162 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:47:06.334971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1315618,"data_compressed":60086,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.771524+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T16:47:04.771524+0000","last_peered":"2024-09-16T16:47:04.771524+0000","last_clean":"2024-09-16T16:47:04.771524+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T16:47:04.771524+0000","last_undegraded":"2024-09-16T16:47:04.771524+0000","last_fullsized":"2024-09-16T16:47:04.771524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.771328+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T16:47:04.771328+0000","last_peered":"2024-09-16T16:47:04.771328+0000","last_clean":"2024-09-16T16:47:04.771328+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T16:47:04.771328+0000","last_undegraded":"2024-09-16T16:47:04.771328+0000","last_fullsized":"2024-09-16T16:47:04.771328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.770535+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T16:47:04.770535+0000","last_peered":"2024-09-16T16:47:04.770535+0000","last_clean":"2024-09-16T16:47:04.770535+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T16:47:04.770535+0000","last_undegraded":"2024-09-16T16:47:04.770535+0000","last_fullsized":"2024-09-16T16:47:04.770535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.766966+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T16:47:04.766966+0000","last_peered":"2024-09-16T16:47:04.766966+0000","last_clean":"2024-09-16T16:47:04.766966+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T16:47:04.766966+0000","last_undegraded":"2024-09-16T16:47:04.766966+0000","last_fullsized":"2024-09-16T16:47:04.766966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.775258+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T16:47:04.775258+0000","last_peered":"2024-09-16T16:47:04.775258+0000","last_clean":"2024-09-16T16:47:04.775258+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T16:47:04.775258+0000","last_undegraded":"2024-09-16T16:47:04.775258+0000","last_fullsized":"2024-09-16T16:47:04.775258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.769314+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T16:47:04.769314+0000","last_peered":"2024-09-16T16:47:04.769314+0000","last_clean":"2024-09-16T16:47:04.769314+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T16:47:04.769314+0000","last_undegraded":"2024-09-16T16:47:04.769314+0000","last_fullsized":"2024-09-16T16:47:04.769314+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.771671+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T16:47:04.771671+0000","last_peered":"2024-09-16T16:47:04.771671+0000","last_clean":"2024-09-16T16:47:04.771671+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T16:47:04.771671+0000","last_undegraded":"2024-09-16T16:47:04.771671+0000","last_fullsized":"2024-09-16T16:47:04.771671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.776351+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T16:47:04.776351+0000","last_peered":"2024-09-16T16:47:04.776351+0000","last_clean":"2024-09-16T16:47:04.776351+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T16:47:04.776351+0000","last_undegraded":"2024-09-16T16:47:04.776351+0000","last_fullsized":"2024-09-16T16:47:04.776351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.767165+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T16:47:04.767165+0000","last_peered":"2024-09-16T16:47:04.767165+0000","last_clean":"2024-09-16T16:47:04.767165+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T16:47:04.767165+0000","last_undegraded":"2024-09-16T16:47:04.767165+0000","last_fullsized":"2024-09-16T16:47:04.767165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":624079,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624098,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:07.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:07.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.270+0000 7ff3cf511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.276+0000 7ff3cf511640 1 Processor -- start 2024-09-16T16:47:07.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.276+0000 7ff3cf511640 1 -- start start 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.277+0000 7ff3cf511640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3c8068d40 0x7ff3c8069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.277+0000 7ff3cf511640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c8075200 con 0x7ff3c8069690 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.277+0000 7ff3cf511640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c806fe90 con 0x7ff3c8068d40 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3cd2ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3c8068d40 0x7ff3c8069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3ccaac640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff3c8069690 0x7ff3c813a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33094/0 (socket says 172.21.15.59:33094) 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3cd2ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3c8068d40 0x7ff3c8069150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48538/0 (socket says 172.21.15.59:48538) 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3ccaac640 1 -- 172.21.15.59:0/2195524002 learned_addr learned my addr 172.21.15.59:0/2195524002 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3cd2ad640 1 -- 172.21.15.59:0/2195524002 >> v1:172.21.15.59:6789/0 conn(0x7ff3c8069690 legacy=0x7ff3c813a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3cd2ad640 1 -- 172.21.15.59:0/2195524002 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c809cc40 con 0x7ff3c8068d40 2024-09-16T16:47:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3bffff640 1 -- 172.21.15.59:0/2195524002 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207361946 0 0) 0x7ff3c8075200 con 0x7ff3c8069690 2024-09-16T16:47:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3cd2ad640 1 --2- 172.21.15.59:0/2195524002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8069150 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253d890cc0ebac9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3bffff640 1 -- 172.21.15.59:0/2195524002 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff3c4009d90 con 0x7ff3c8068d40 2024-09-16T16:47:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3bffff640 1 -- 172.21.15.59:0/2195524002 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff3c400e230 con 0x7ff3c8068d40 2024-09-16T16:47:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.278+0000 7ff3bffff640 1 -- 172.21.15.59:0/2195524002 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff3c400e4d0 con 0x7ff3c8068d40 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 -- 172.21.15.59:0/2195524002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 msgr2=0x7ff3c8069150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 --2- 172.21.15.59:0/2195524002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8069150 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 -- 172.21.15.59:0/2195524002 shutdown_connections 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 --2- 172.21.15.59:0/2195524002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8069150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 -- 172.21.15.59:0/2195524002 >> 172.21.15.59:0/2195524002 conn(0x7ff3c80a31a0 msgr2=0x7ff3c80a35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 -- 172.21.15.59:0/2195524002 shutdown_connections 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 1 -- 172.21.15.59:0/2195524002 wait complete. 2024-09-16T16:47:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.279+0000 7ff3cf511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.281+0000 7ff3cf511640 1 Processor -- start 2024-09-16T16:47:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.281+0000 7ff3cf511640 1 -- start start 2024-09-16T16:47:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cf511640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8097e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cf511640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c809b6f0 con 0x7ff3c8068d40 2024-09-16T16:47:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cd2ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8097e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cd2ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8097e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48544/0 (socket says 172.21.15.59:48544) 2024-09-16T16:47:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cd2ad640 1 -- 172.21.15.59:0/1330040095 learned_addr learned my addr 172.21.15.59:0/1330040095 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cd2ad640 1 -- 172.21.15.59:0/1330040095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c8074d10 con 0x7ff3c8068d40 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.283+0000 7ff3cd2ad640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8097e70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.284+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff3c4014620 con 0x7ff3c8068d40 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.284+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff3c4014780 con 0x7ff3c8068d40 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.284+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c809b950 con 0x7ff3c8068d40 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.284+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff3c4014a20 con 0x7ff3c8068d40 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.284+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c809a900 con 0x7ff3c8068d40 2024-09-16T16:47:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.285+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff3c4014b80 con 0x7ff3c8068d40 2024-09-16T16:47:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.285+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c8069150 con 0x7ff3c8068d40 2024-09-16T16:47:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.285+0000 7ff3bdffb640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff3ac03e960 0x7ff3ac040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.285+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7ff3c4019040 con 0x7ff3c8068d40 2024-09-16T16:47:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.286+0000 7ff3ccaac640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff3ac03e960 0x7ff3ac040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.286+0000 7ff3ccaac640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff3ac03e960 0x7ff3ac040e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.290+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff3c4011570 con 0x7ff3c8068d40 2024-09-16T16:47:07.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.476+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3c80a0470 con 0x7ff3ac03e960 2024-09-16T16:47:07.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.477+0000 7ff3bdffb640 1 -- 172.21.15.59:0/1330040095 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31131 (crc 0 0 0) 0x7ff3b8005930 con 0x7ff3ac03e960 2024-09-16T16:47:07.478 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:07.479 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff3ac03e960 msgr2=0x7ff3ac040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff3ac03e960 0x7ff3ac040e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 msgr2=0x7ff3c8097e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8097e70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 shutdown_connections 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff3ac03e960 0x7ff3ac040e70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 --2- 172.21.15.59:0/1330040095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c8068d40 0x7ff3c8097e70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 >> 172.21.15.59:0/1330040095 conn(0x7ff3c80a31a0 msgr2=0x7ff3c8090eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 shutdown_connections 2024-09-16T16:47:07.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.480+0000 7ff3cf511640 1 -- 172.21.15.59:0/1330040095 wait complete. 2024-09-16T16:47:07.492 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:47:06.334971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1315618,"data_compressed":60086,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.771524+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T16:47:04.771524+0000","last_peered":"2024-09-16T16:47:04.771524+0000","last_clean":"2024-09-16T16:47:04.771524+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T16:47:04.771524+0000","last_undegraded":"2024-09-16T16:47:04.771524+0000","last_fullsized":"2024-09-16T16:47:04.771524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.771328+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T16:47:04.771328+0000","last_peered":"2024-09-16T16:47:04.771328+0000","last_clean":"2024-09-16T16:47:04.771328+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T16:47:04.771328+0000","last_undegraded":"2024-09-16T16:47:04.771328+0000","last_fullsized":"2024-09-16T16:47:04.771328+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.770535+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T16:47:04.770535+0000","last_peered":"2024-09-16T16:47:04.770535+0000","last_clean":"2024-09-16T16:47:04.770535+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T16:47:04.770535+0000","last_undegraded":"2024-09-16T16:47:04.770535+0000","last_fullsized":"2024-09-16T16:47:04.770535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.766966+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T16:47:04.766966+0000","last_peered":"2024-09-16T16:47:04.766966+0000","last_clean":"2024-09-16T16:47:04.766966+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T16:47:04.766966+0000","last_undegraded":"2024-09-16T16:47:04.766966+0000","last_fullsized":"2024-09-16T16:47:04.766966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.775258+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T16:47:04.775258+0000","last_peered":"2024-09-16T16:47:04.775258+0000","last_clean":"2024-09-16T16:47:04.775258+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T16:47:04.775258+0000","last_undegraded":"2024-09-16T16:47:04.775258+0000","last_fullsized":"2024-09-16T16:47:04.775258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.769314+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T16:47:04.769314+0000","last_peered":"2024-09-16T16:47:04.769314+0000","last_clean":"2024-09-16T16:47:04.769314+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T16:47:04.769314+0000","last_undegraded":"2024-09-16T16:47:04.769314+0000","last_fullsized":"2024-09-16T16:47:04.769314+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.771671+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T16:47:04.771671+0000","last_peered":"2024-09-16T16:47:04.771671+0000","last_clean":"2024-09-16T16:47:04.771671+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T16:47:04.771671+0000","last_undegraded":"2024-09-16T16:47:04.771671+0000","last_fullsized":"2024-09-16T16:47:04.771671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.776351+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T16:47:04.776351+0000","last_peered":"2024-09-16T16:47:04.776351+0000","last_clean":"2024-09-16T16:47:04.776351+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T16:47:04.776351+0000","last_undegraded":"2024-09-16T16:47:04.776351+0000","last_fullsized":"2024-09-16T16:47:04.776351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:47:04.767165+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T16:47:04.767165+0000","last_peered":"2024-09-16T16:47:04.767165+0000","last_clean":"2024-09-16T16:47:04.767165+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T16:47:04.767165+0000","last_undegraded":"2024-09-16T16:47:04.767165+0000","last_fullsized":"2024-09-16T16:47:04.767165+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":624079,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624098,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:07.492 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:47:07.492 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T16:47:07.492 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T16:47:07.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T16:47:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.602+0000 7efce7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.606+0000 7efce7751640 1 Processor -- start 2024-09-16T16:47:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.606+0000 7efce7751640 1 -- start start 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce7751640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efce01360f0 0x7efce0136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce7751640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce00a5c40 con 0x7efce009e170 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce7751640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efce00a6010 con 0x7efce01360f0 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce54ed640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efce01360f0 0x7efce0136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce54ed640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efce01360f0 0x7efce0136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48548/0 (socket says 172.21.15.59:48548) 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce4cec640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efce009e170 0x7efce009e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33102/0 (socket says 172.21.15.59:33102) 2024-09-16T16:47:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce54ed640 1 -- 172.21.15.59:0/1466040336 learned_addr learned my addr 172.21.15.59:0/1466040336 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce54ed640 1 -- 172.21.15.59:0/1466040336 >> v1:172.21.15.59:6789/0 conn(0x7efce009e170 legacy=0x7efce009e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce54ed640 1 -- 172.21.15.59:0/1466040336 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce009f510 con 0x7efce01360f0 2024-09-16T16:47:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efce54ed640 1 --2- 172.21.15.59:0/1466040336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01360f0 0x7efce0136500 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8b2785d3746756 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.608+0000 7efcd7fff640 1 -- 172.21.15.59:0/1466040336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efcdc009e50 con 0x7efce01360f0 2024-09-16T16:47:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efcd7fff640 1 -- 172.21.15.59:0/1466040336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efcdc00e230 con 0x7efce01360f0 2024-09-16T16:47:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efcd7fff640 1 -- 172.21.15.59:0/1466040336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efcdc00e4d0 con 0x7efce01360f0 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 -- 172.21.15.59:0/1466040336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01360f0 msgr2=0x7efce0136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 --2- 172.21.15.59:0/1466040336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01360f0 0x7efce0136500 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 -- 172.21.15.59:0/1466040336 shutdown_connections 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 --2- 172.21.15.59:0/1466040336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01360f0 0x7efce0136500 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 -- 172.21.15.59:0/1466040336 >> 172.21.15.59:0/1466040336 conn(0x7efce006f850 msgr2=0x7efce009ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 -- 172.21.15.59:0/1466040336 shutdown_connections 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.609+0000 7efce7751640 1 -- 172.21.15.59:0/1466040336 wait complete. 2024-09-16T16:47:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.610+0000 7efce7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.611+0000 7efce7751640 1 Processor -- start 2024-09-16T16:47:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.611+0000 7efce7751640 1 -- start start 2024-09-16T16:47:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce7751640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 0x7efce01250c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce7751640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efce01272d0 con 0x7efce009e170 2024-09-16T16:47:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce54ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 0x7efce01250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce54ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 0x7efce01250c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48554/0 (socket says 172.21.15.59:48554) 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce54ed640 1 -- 172.21.15.59:0/3607759345 learned_addr learned my addr 172.21.15.59:0/3607759345 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce54ed640 1 -- 172.21.15.59:0/3607759345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0126a10 con 0x7efce009e170 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efce54ed640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 0x7efce01250c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.613+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efcdc00eda0 con 0x7efce009e170 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.614+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efcdc015420 con 0x7efce009e170 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.614+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce0128380 con 0x7efce009e170 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.614+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efcdc0156c0 con 0x7efce009e170 2024-09-16T16:47:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.614+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce0128b20 con 0x7efce009e170 2024-09-16T16:47:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.615+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efcdc015870 con 0x7efce009e170 2024-09-16T16:47:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.615+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce0128de0 con 0x7efce009e170 2024-09-16T16:47:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.615+0000 7efcd5ffb640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efcc403e960 0x7efcc4040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:47:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.615+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7efcdc050dd0 con 0x7efce009e170 2024-09-16T16:47:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.615+0000 7efce4cec640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efcc403e960 0x7efcc4040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:47:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.616+0000 7efce4cec640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efcc403e960 0x7efcc4040e70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:47:07.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.620+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7efcdc00f2a0 con 0x7efce009e170 2024-09-16T16:47:07.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.847+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efce0129000 con 0x7efce009e170 2024-09-16T16:47:07.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.847+0000 7efcd5ffb640 1 -- 172.21.15.59:0/3607759345 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7efcdc0129e0 con 0x7efce009e170 2024-09-16T16:47:07.848 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T16:47:07.848 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efcc403e960 msgr2=0x7efcc4040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efcc403e960 0x7efcc4040e70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 msgr2=0x7efce01250c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 0x7efce01250c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 shutdown_connections 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efcc403e960 0x7efcc4040e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 --2- 172.21.15.59:0/3607759345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009e170 0x7efce01250c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:47:07.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 >> 172.21.15.59:0/3607759345 conn(0x7efce006f850 msgr2=0x7efce00a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:47:07.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 shutdown_connections 2024-09-16T16:47:07.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T16:47:07.849+0000 7efce7751640 1 -- 172.21.15.59:0/3607759345 wait complete. 2024-09-16T16:47:07.861 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T16:47:07.861 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T16:47:07.874 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:47:07.874 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T16:47:07.874 DEBUG:teuthology.orchestra.run.smithi059:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:47:07.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:47:07.890 INFO:teuthology.orchestra.run.smithi059.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T16:47:07.890 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:47:07.946 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T16:47:07.946 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T16:47:08.002 INFO:tasks.workunit:timeout=3h 2024-09-16T16:47:08.002 INFO:tasks.workunit:cleanup=True 2024-09-16T16:47:08.002 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:47:08.058 INFO:tasks.workunit.client.0.smithi059.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T16:47:58.995 INFO:tasks.workunit.client.0.smithi059.stderr:Updating files: 93% (11288/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.501 INFO:tasks.workunit.client.0.smithi059.stderr: git switch -c 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr:Or undo this operation with: 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr: git switch - 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-16T16:47:59.502 INFO:tasks.workunit.client.0.smithi059.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T16:47:59.506 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T16:47:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T16:47:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:47:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T16:48:00.210 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T16:48:00.293 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T16:48:00.334 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:48:00.336 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:48:00.336 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T16:48:00.377 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:48:00.381 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-16T16:48:00.381 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T16:48:00.437 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-16T16:48:00.438 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-16T16:48:00.438 DEBUG:teuthology.orchestra.run.smithi059:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-16T16:48:00.498 INFO:tasks.workunit.client.0.smithi059.stderr:+ parallel=1 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' --crimson = --serial ']' 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ crimson=0 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' --crimson = --crimson ']' 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ parallel=0 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ crimson=1 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ color= 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' -t 1 ']' 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-16T16:48:00.499 INFO:tasks.workunit.client.0.smithi059.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-16T16:48:00.500 INFO:tasks.workunit.client.0.smithi059.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-16T16:48:00.500 INFO:tasks.workunit.client.0.smithi059.stderr:+ declare -A pids 2024-09-16T16:48:00.500 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:48:00.500 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:48:00.500 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_aio 2024-09-16T16:48:00.517 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:48:00.517 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-16T16:48:00.517 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:48:00.517 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 26 tests from LibRadosAio 2024-09-16T16:48:00.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-16T16:48:03.425 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.TooBig (2908 ms) 2024-09-16T16:48:03.425 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-16T16:48:06.447 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.SimpleWrite (3023 ms) 2024-09-16T16:48:06.447 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-16T16:48:09.463 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.WaitForSafe (3016 ms) 2024-09-16T16:48:09.463 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-16T16:48:12.476 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTrip (3012 ms) 2024-09-16T16:48:12.476 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-16T16:48:15.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTrip2 (3020 ms) 2024-09-16T16:48:15.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-16T16:48:18.512 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTrip3 (3017 ms) 2024-09-16T16:48:18.512 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-16T16:48:21.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripAppend (3013 ms) 2024-09-16T16:48:21.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-16T16:48:24.546 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RemoveTest (3021 ms) 2024-09-16T16:48:24.547 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-16T16:48:27.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3011 ms) 2024-09-16T16:48:27.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-16T16:48:30.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RmXattr (3022 ms) 2024-09-16T16:48:30.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-16T16:48:33.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.XattrIter (3011 ms) 2024-09-16T16:48:33.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-16T16:48:36.609 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.IsComplete (3018 ms) 2024-09-16T16:48:36.609 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-16T16:48:39.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.IsSafe (3011 ms) 2024-09-16T16:48:39.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-16T16:48:42.646 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.ReturnValue (3027 ms) 2024-09-16T16:48:42.647 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.Flush 2024-09-16T16:48:45.655 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.Flush (3008 ms) 2024-09-16T16:48:45.655 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-16T16:48:48.678 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.FlushAsync (3024 ms) 2024-09-16T16:48:48.679 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-16T16:48:51.692 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3014 ms) 2024-09-16T16:48:51.692 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-16T16:48:54.708 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3015 ms) 2024-09-16T16:48:54.709 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-16T16:48:57.415 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.SimpleStat (2707 ms) 2024-09-16T16:48:57.416 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-16T16:49:00.427 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.OperateMtime (3011 ms) 2024-09-16T16:49:00.427 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-16T16:49:03.435 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.Operate2Mtime (3009 ms) 2024-09-16T16:49:03.436 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-16T16:49:06.459 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.SimpleStatNS (3024 ms) 2024-09-16T16:49:06.459 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-16T16:49:09.469 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.StatRemove (3010 ms) 2024-09-16T16:49:09.470 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-16T16:49:12.483 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.ExecuteClass (3013 ms) 2024-09-16T16:49:12.483 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-16T16:49:15.495 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.MultiWrite (3012 ms) 2024-09-16T16:49:15.495 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-16T16:49:18.515 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.AioUnlock (3019 ms) 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 26 tests from LibRadosAio (77997 ms total) 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1100: Skipped 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1132: Skipped 2024-09-16T16:49:18.516 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1149: Skipped 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1182: Skipped 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1215: Skipped 2024-09-16T16:49:18.517 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1286: Skipped 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1326: Skipped 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1366: Skipped 2024-09-16T16:49:18.518 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1385: Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1415: Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1454: Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.519 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1498: Skipped 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1532: Skipped 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1593: Skipped 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-16T16:49:18.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1649: Skipped 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1681: Skipped 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 42 tests from 2 test suites ran. (77997 ms total) 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 26 tests. 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T16:49:18.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-16T16:49:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-16T16:49:18.523 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:49:18.523 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:49:18.523 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_aio_pp 2024-09-16T16:49:18.541 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:49:18.541 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-16T16:49:18.541 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:49:18.541 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 32 tests from LibRadosAio 2024-09-16T16:49:18.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-16T16:49:21.420 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.TooBigPP (2879 ms) 2024-09-16T16:49:21.420 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-16T16:49:38.507 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.PoolQuotaPP (17087 ms) 2024-09-16T16:49:38.507 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-16T16:49:44.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.SimpleWritePP (6078 ms) 2024-09-16T16:49:44.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-16T16:49:47.426 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.WaitForSafePP (2841 ms) 2024-09-16T16:49:47.426 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-16T16:49:50.438 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripPP (3012 ms) 2024-09-16T16:49:50.438 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-16T16:49:53.456 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3017 ms) 2024-09-16T16:49:53.456 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-16T16:49:56.426 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2970 ms) 2024-09-16T16:49:56.426 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-16T16:49:59.436 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3010 ms) 2024-09-16T16:49:59.436 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-16T16:50:02.456 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.IsCompletePP (3020 ms) 2024-09-16T16:50:02.456 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-16T16:50:05.469 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.IsSafePP (3013 ms) 2024-09-16T16:50:05.469 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-16T16:50:08.481 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.ReturnValuePP (3012 ms) 2024-09-16T16:50:08.481 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-16T16:50:11.501 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.FlushPP (3021 ms) 2024-09-16T16:50:11.502 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-16T16:50:14.529 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3027 ms) 2024-09-16T16:50:14.529 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-16T16:50:17.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3009 ms) 2024-09-16T16:50:17.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-16T16:50:20.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3019 ms) 2024-09-16T16:50:20.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-16T16:50:23.567 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3010 ms) 2024-09-16T16:50:23.567 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-16T16:50:26.433 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2865 ms) 2024-09-16T16:50:26.433 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-16T16:50:29.441 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3009 ms) 2024-09-16T16:50:29.442 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-16T16:50:32.461 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.SimpleStatPP (3019 ms) 2024-09-16T16:50:32.461 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-16T16:50:35.473 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.OperateMtime (3012 ms) 2024-09-16T16:50:35.473 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-16T16:50:38.480 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.OperateMtime2 (3008 ms) 2024-09-16T16:50:38.481 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-16T16:50:41.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.StatRemovePP (3012 ms) 2024-09-16T16:50:41.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-16T16:50:44.513 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3020 ms) 2024-09-16T16:50:44.513 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-16T16:50:47.530 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.OmapPP (3018 ms) 2024-09-16T16:50:47.531 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-16T16:50:50.551 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.MultiWritePP (3020 ms) 2024-09-16T16:50:50.551 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-16T16:50:53.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.AioUnlockPP (3014 ms) 2024-09-16T16:50:53.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-16T16:50:56.440 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2875 ms) 2024-09-16T16:50:56.440 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-16T16:50:59.449 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RacingRemovePP (3010 ms) 2024-09-16T16:50:59.449 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-16T16:51:02.474 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3024 ms) 2024-09-16T16:51:02.474 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-16T16:51:05.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3015 ms) 2024-09-16T16:51:05.490 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-16T16:51:07.942 INFO:tasks.workunit.client.0.smithi059.stdout:setting pool EIO 2024-09-16T16:51:17.628 INFO:tasks.workunit.client.0.smithi059.stdout:waiting for 892 2024-09-16T16:51:18.629 INFO:tasks.workunit.client.0.smithi059.stdout:waiting for 892 2024-09-16T16:51:19.629 INFO:tasks.workunit.client.0.smithi059.stdout:waiting for 892 2024-09-16T16:51:20.629 INFO:tasks.workunit.client.0.smithi059.stdout:max_success 108, min_failed 109 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15348 ms) 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 32 tests from LibRadosAio (122296 ms total) 2024-09-16T16:51:20.837 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:51:20.838 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-16T16:51:20.838 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-16T16:51:23.461 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (2624 ms) 2024-09-16T16:51:23.461 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-16T16:51:32.450 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8989 ms) 2024-09-16T16:51:32.450 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-16T16:51:47.467 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15017 ms) 2024-09-16T16:51:47.468 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-16T16:51:50.481 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3014 ms) 2024-09-16T16:51:50.481 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosAioPP (29644 ms total) 2024-09-16T16:51:50.481 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:51:50.481 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosIoPP 2024-09-16T16:51:50.481 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-16T16:51:53.484 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.XattrListPP (3002 ms) 2024-09-16T16:51:53.484 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosIoPP (3002 ms total) 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-16T16:51:53.485 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-16T16:51:53.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-16T16:51:53.487 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-16T16:51:53.490 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-16T16:51:53.491 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 20 tests from LibRadosAioEC (1 ms total) 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 57 tests from 4 test suites ran. (154943 ms total) 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 36 tests. 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-16T16:51:53.492 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-16T16:51:53.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-16T16:51:53.494 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:51:53.494 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:51:53.494 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_io 2024-09-16T16:51:53.511 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:51:53.511 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-16T16:51:53.511 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:51:53.511 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from LibRadosIo 2024-09-16T16:51:55.494 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-16T16:51:55.817 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.SimpleWrite (323 ms) 2024-09-16T16:51:55.817 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-16T16:51:55.817 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-16T16:51:55.817 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-16T16:51:55.891 INFO:tasks.workunit.client.0.smithi059.stdout:no timeout :/ 2024-09-16T16:51:55.891 INFO:tasks.workunit.client.0.smithi059.stdout:no timeout :/ 2024-09-16T16:51:55.891 INFO:tasks.workunit.client.0.smithi059.stdout:no timeout :/ 2024-09-16T16:51:55.892 INFO:tasks.workunit.client.0.smithi059.stdout:no timeout :/ 2024-09-16T16:51:55.892 INFO:tasks.workunit.client.0.smithi059.stdout:no timeout :/ 2024-09-16T16:51:55.892 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.ReadTimeout (75 ms) 2024-09-16T16:51:55.892 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-16T16:51:55.934 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.RoundTrip (42 ms) 2024-09-16T16:51:55.934 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-16T16:51:55.954 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.Checksum (20 ms) 2024-09-16T16:51:55.954 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-16T16:51:55.991 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (37 ms) 2024-09-16T16:51:55.992 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-16T16:51:56.022 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (30 ms) 2024-09-16T16:51:56.022 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-16T16:51:56.056 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.AppendRoundTrip (34 ms) 2024-09-16T16:51:56.056 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-16T16:51:56.061 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-09-16T16:51:56.061 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-16T16:51:56.090 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.TruncTest (29 ms) 2024-09-16T16:51:56.090 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-16T16:51:56.121 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.RemoveTest (30 ms) 2024-09-16T16:51:56.121 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-16T16:51:56.155 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (35 ms) 2024-09-16T16:51:56.155 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-16T16:51:56.241 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.RmXattr (86 ms) 2024-09-16T16:51:56.241 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-16T16:51:56.285 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIo.XattrIter (45 ms) 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from LibRadosIo (792 ms total) 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.504 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.505 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.506 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.507 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:56.508 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 24 tests from 2 test suites ran. (2990 ms total) 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 14 tests. 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-16T16:51:56.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-16T16:51:56.510 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:51:56.511 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:51:56.511 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_io_pp 2024-09-16T16:51:56.525 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:51:56.525 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-16T16:51:56.525 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:51:56.526 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-16T16:51:56.526 INFO:tasks.workunit.client.0.smithi059.stdout:seed 31030 2024-09-16T16:51:58.513 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-16T16:51:58.513 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-16T16:51:58.513 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-16T16:51:58.863 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (350 ms) 2024-09-16T16:51:58.863 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-16T16:51:58.938 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.ReadOpPP (75 ms) 2024-09-16T16:51:58.938 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-16T16:51:58.964 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (27 ms) 2024-09-16T16:51:58.964 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-16T16:52:01.771 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2807 ms) 2024-09-16T16:52:01.772 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-16T16:52:01.791 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.RoundTripPP (19 ms) 2024-09-16T16:52:01.791 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-16T16:52:01.809 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (19 ms) 2024-09-16T16:52:01.809 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-16T16:52:01.829 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.Checksum (19 ms) 2024-09-16T16:52:01.829 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-16T16:52:01.855 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (27 ms) 2024-09-16T16:52:01.856 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-16T16:52:01.890 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (35 ms) 2024-09-16T16:52:01.890 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-16T16:52:01.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (29 ms) 2024-09-16T16:52:01.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-16T16:52:01.938 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (18 ms) 2024-09-16T16:52:01.938 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-16T16:52:01.973 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (35 ms) 2024-09-16T16:52:01.973 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-16T16:52:02.005 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.TruncTestPP (33 ms) 2024-09-16T16:52:02.005 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-16T16:52:02.036 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (30 ms) 2024-09-16T16:52:02.036 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-16T16:52:02.071 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (35 ms) 2024-09-16T16:52:02.071 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-16T16:52:02.157 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.RmXattrPP (87 ms) 2024-09-16T16:52:02.157 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-16T16:52:02.200 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.XattrListPP (42 ms) 2024-09-16T16:52:02.200 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-16T16:52:02.229 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (29 ms) 2024-09-16T16:52:02.229 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-16T16:52:02.260 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.CmpExtPP (31 ms) 2024-09-16T16:52:02.260 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-16T16:52:02.279 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (20 ms) 2024-09-16T16:52:02.280 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-16T16:52:02.304 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (24 ms) 2024-09-16T16:52:02.534 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 22 tests from LibRadosIoPP (3791 ms total) 2024-09-16T16:52:02.534 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (1 ms) 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.535 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-16T16:52:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.537 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-16T16:52:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.540 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:52:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 18 tests from LibRadosIoECPP (1 ms total) 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 40 tests from 2 test suites ran. (6004 ms total) 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 22 tests. 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-16T16:52:02.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:02.544 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:02.545 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_asio 2024-09-16T16:52:02.569 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.568+0000 7f8d4162d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:02.583 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.583+0000 7f8d4162d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:02.583 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.583+0000 7f8d4162d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:02.584 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-16T16:52:02.584 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:02.584 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 12 tests from AsioRados 2024-09-16T16:52:02.585 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.585+0000 7f8d4162d6c0 1 Processor -- start 2024-09-16T16:52:02.587 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.585+0000 7f8d4162d6c0 1 -- start start 2024-09-16T16:52:02.588 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.587+0000 7f8d4162d6c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xdde5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:52:02.588 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.587+0000 7f8d4162d6c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xc19520 con 0xcb2930 2024-09-16T16:52:02.588 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.587+0000 7f8d39a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xdde5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:52:02.588 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.588+0000 7f8d39a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xdde5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34956/0 (socket says 172.21.15.59:34956) 2024-09-16T16:52:02.589 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.588+0000 7f8d39a3f640 1 -- 172.21.15.59:0/2290810633 learned_addr learned my addr 172.21.15.59:0/2290810633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:52:02.589 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.588+0000 7f8d39a3f640 1 -- 172.21.15.59:0/2290810633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbb5e10 con 0xcb2930 2024-09-16T16:52:02.591 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.591+0000 7f8d39a3f640 1 --2- 172.21.15.59:0/2290810633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xdde5c0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bc277b5a9a025c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:52:02.592 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.592+0000 7f8d337fe640 1 -- 172.21.15.59:0/2290810633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d1c00b500 con 0xcb2930 2024-09-16T16:52:02.592 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.592+0000 7f8d337fe640 1 -- 172.21.15.59:0/2290810633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8d1c00b660 con 0xcb2930 2024-09-16T16:52:02.594 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.593+0000 7f8d337fe640 1 -- 172.21.15.59:0/2290810633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d1c00b900 con 0xcb2930 2024-09-16T16:52:02.594 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.593+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/2290810633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 msgr2=0xdde5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:02.594 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.593+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/2290810633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xdde5c0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:02.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.597+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/2290810633 shutdown_connections 2024-09-16T16:52:02.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.597+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/2290810633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xdde5c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:02.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.597+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/2290810633 >> 172.21.15.59:0/2290810633 conn(0xbd9770 msgr2=0xcada70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:52:02.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.597+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/2290810633 shutdown_connections 2024-09-16T16:52:02.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.597+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/2290810633 wait complete. 2024-09-16T16:52:02.600 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.599+0000 7f8d4162d6c0 1 Processor -- start 2024-09-16T16:52:02.600 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.599+0000 7f8d4162d6c0 1 -- start start 2024-09-16T16:52:02.603 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.602+0000 7f8d4162d6c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xde60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:52:02.604 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.604+0000 7f8d4162d6c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xc17280 con 0xcb2930 2024-09-16T16:52:02.605 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.604+0000 7f8d39a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xde60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:52:02.605 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.604+0000 7f8d39a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xde60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34962/0 (socket says 172.21.15.59:34962) 2024-09-16T16:52:02.605 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.604+0000 7f8d39a3f640 1 -- 172.21.15.59:0/3821513613 learned_addr learned my addr 172.21.15.59:0/3821513613 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T16:52:02.606 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.606+0000 7f8d39a3f640 1 -- 172.21.15.59:0/3821513613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xba7920 con 0xcb2930 2024-09-16T16:52:02.607 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.606+0000 7f8d39a3f640 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xde60f0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:52:02.607 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.606+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d1c0111e0 con 0xcb2930 2024-09-16T16:52:02.607 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.606+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8d1c0117a0 con 0xcb2930 2024-09-16T16:52:02.607 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.606+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xba7380 con 0xcb2930 2024-09-16T16:52:02.608 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.607+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d1c011910 con 0xcb2930 2024-09-16T16:52:02.608 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.608+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0xddfbd0 con 0xcb2930 2024-09-16T16:52:02.609 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.608+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8d1c011ac0 con 0xcb2930 2024-09-16T16:52:02.609 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.609+0000 7f8d327fc640 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8d1403d210 0x7f8d1403f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:52:02.609 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.609+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 2700+0+0 (crc 0 0 0) 0x7f8d1c04fc50 con 0xcb2930 2024-09-16T16:52:02.609 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.609+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xc0fdf0 con 0xcb2930 2024-09-16T16:52:02.610 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.609+0000 7f8d3923e640 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8d1403d210 0x7f8d1403f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:52:02.610 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.609+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7f8d1c016040 con 0xcb2930 2024-09-16T16:52:02.611 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.610+0000 7f8d3923e640 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8d1403d210 0x7f8d1403f720 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:52:02.611 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:02.610+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0xc22bf0 con 0xcb2930 2024-09-16T16:52:03.532 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.531+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7f8d1c0088c0 con 0xcb2930 2024-09-16T16:52:03.532 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.531+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7f8d14041b90 con 0xcb2930 2024-09-16T16:52:03.532 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.531+0000 7f8d327fc640 1 -- 172.21.15.59:0/3821513613 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(236..236 src has 1..236) ==== 651+0+0 (crc 0 0 0) 0x7f8d1c012040 con 0xcb2930 2024-09-16T16:52:03.533 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.532+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> v2:172.21.15.59:6811/1210870840 conn(0xcb2d40 0xdeaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:52:03.533 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.532+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xdeb400 con 0xcb2d40 2024-09-16T16:52:03.537 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.537+0000 7f8d3a240640 1 --2- 172.21.15.59:0/3821513613 >> v2:172.21.15.59:6811/1210870840 conn(0xcb2d40 0xdeaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:52:03.594 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:03.594+0000 7f8d3a240640 1 --2- 172.21.15.59:0/3821513613 >> v2:172.21.15.59:6811/1210870840 conn(0xcb2d40 0xdeaec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:52:04.718 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.717+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.718 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-16T16:52:04.718 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.717+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xd35210 con 0xcb2d40 2024-09-16T16:52:04.718 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.717+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xd35a90 con 0xcb2d40 2024-09-16T16:52:04.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.729+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.729+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.730 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncReadCallback (12 ms) 2024-09-16T16:52:04.730 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-16T16:52:04.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.729+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xd38300 con 0xcb2d40 2024-09-16T16:52:04.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.729+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xdeb760 con 0xcb2d40 2024-09-16T16:52:04.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.740+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.741+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.742 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncReadFuture (11 ms) 2024-09-16T16:52:04.742 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-16T16:52:04.742 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.741+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xd355c0 con 0xcb2d40 2024-09-16T16:52:04.742 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.741+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xe2bf90 con 0xcb2d40 2024-09-16T16:52:04.760 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.759+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.760 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.759+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.760 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncReadYield (19 ms) 2024-09-16T16:52:04.761 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-16T16:52:04.761 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.759+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xdecad0 con 0xcb2d40 2024-09-16T16:52:04.780 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.779+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.780 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncWriteCallback (20 ms) 2024-09-16T16:52:04.780 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-16T16:52:04.781 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.779+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xdecad0 con 0xcb2d40 2024-09-16T16:52:04.801 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.801+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.802 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncWriteFuture (22 ms) 2024-09-16T16:52:04.802 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-16T16:52:04.802 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.801+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xe0ec80 con 0xcb2d40 2024-09-16T16:52:04.818 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.817+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.818 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncWriteYield (16 ms) 2024-09-16T16:52:04.818 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-16T16:52:04.818 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.817+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xdebac0 con 0xcb2d40 2024-09-16T16:52:04.819 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.817+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xdec420 con 0xcb2d40 2024-09-16T16:52:04.828 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.827+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.830 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.830+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.831 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (13 ms) 2024-09-16T16:52:04.831 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-16T16:52:04.831 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.830+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xdebac0 con 0xcb2d40 2024-09-16T16:52:04.831 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.830+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xe0f190 con 0xcb2d40 2024-09-16T16:52:04.845 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.844+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.845 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.844+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.845 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (14 ms) 2024-09-16T16:52:04.845 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-16T16:52:04.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.844+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xe0ec80 con 0xcb2d40 2024-09-16T16:52:04.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.844+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xe0f540 con 0xcb2d40 2024-09-16T16:52:04.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.858+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.859+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.859 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncReadOperationYield (15 ms) 2024-09-16T16:52:04.860 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-16T16:52:04.860 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.859+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xdec0c0 con 0xcb2d40 2024-09-16T16:52:04.875 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.874+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.875 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (15 ms) 2024-09-16T16:52:04.875 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-16T16:52:04.875 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.874+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xdec0c0 con 0xcb2d40 2024-09-16T16:52:04.892 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.891+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.892 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (17 ms) 2024-09-16T16:52:04.892 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-16T16:52:04.892 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.891+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xdec0c0 con 0xcb2d40 2024-09-16T16:52:04.909 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d3a240640 1 -- 172.21.15.59:0/3821513613 <== osd.1 v2:172.21.15.59:6811/1210870840 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d2c00a430 con 0xcb2d40 2024-09-16T16:52:04.909 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (17 ms) 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 >> v2:172.21.15.59:6811/1210870840 conn(0xcb2d40 msgr2=0xdeaec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> v2:172.21.15.59:6811/1210870840 conn(0xcb2d40 0xdeaec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8d1403d210 msgr2=0x7f8d1403f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8d1403d210 0x7f8d1403f720 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 msgr2=0xde60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xde60f0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:04.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 shutdown_connections 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> v2:172.21.15.59:6811/1210870840 conn(0xcb2d40 0xdeaec0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8d1403d210 0x7f8d1403f720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 --2- 172.21.15.59:0/3821513613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xcb2930 0xde60f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.908+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 >> 172.21.15.59:0/3821513613 conn(0xbd9770 msgr2=0xcaf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.909+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 shutdown_connections 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.909+0000 7f8d4162d6c0 1 -- 172.21.15.59:0/3821513613 wait complete. 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 12 tests from AsioRados (191 ms total) 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:04.911 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 12 tests from 1 test suite ran. (2326 ms total) 2024-09-16T16:52:04.912 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 12 tests. 2024-09-16T16:52:04.912 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:04.913 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:04.913 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_list 2024-09-16T16:52:04.945 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.944+0000 7f187823c9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:04.945 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.944+0000 7f187823c9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:04.945 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:04.944+0000 7f187823c9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:04.945 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-16T16:52:04.946 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:04.946 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from LibRadosList 2024-09-16T16:52:06.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-16T16:52:07.092 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.ListObjects (550 ms) 2024-09-16T16:52:07.093 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-16T16:52:07.341 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (248 ms) 2024-09-16T16:52:07.341 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-16T16:52:07.447 INFO:tasks.workunit.client.0.smithi059.stdout:myset foo1,foo2,foo3 2024-09-16T16:52:07.544 INFO:tasks.workunit.client.0.smithi059.stdout:foo1 2024-09-16T16:52:07.545 INFO:tasks.workunit.client.0.smithi059.stdout:foo2 2024-09-16T16:52:07.545 INFO:tasks.workunit.client.0.smithi059.stdout:foo3 2024-09-16T16:52:07.545 INFO:tasks.workunit.client.0.smithi059.stdout:myset foo1,foo4,foo5 2024-09-16T16:52:07.672 INFO:tasks.workunit.client.0.smithi059.stdout:foo4 2024-09-16T16:52:07.672 INFO:tasks.workunit.client.0.smithi059.stdout:foo5 2024-09-16T16:52:07.672 INFO:tasks.workunit.client.0.smithi059.stdout:foo1 2024-09-16T16:52:07.673 INFO:tasks.workunit.client.0.smithi059.stdout:myset foo6,foo7 2024-09-16T16:52:07.770 INFO:tasks.workunit.client.0.smithi059.stdout:foo7 2024-09-16T16:52:07.770 INFO:tasks.workunit.client.0.smithi059.stdout:foo6 2024-09-16T16:52:07.770 INFO:tasks.workunit.client.0.smithi059.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout:ns1:foo4 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout:ns1:foo5 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout:ns2:foo7 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout:ns2:foo6 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout:ns1:foo1 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout::foo1 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout::foo2 2024-09-16T16:52:07.868 INFO:tasks.workunit.client.0.smithi059.stdout::foo3 2024-09-16T16:52:08.061 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.ListObjectsNS (720 ms) 2024-09-16T16:52:08.061 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:1 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:10 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:13 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:7 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:14 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:0 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:15 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:11 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:5 0 2024-09-16T16:52:08.374 INFO:tasks.workunit.client.0.smithi059.stdout:8 0 2024-09-16T16:52:08.375 INFO:tasks.workunit.client.0.smithi059.stdout:6 0 2024-09-16T16:52:08.375 INFO:tasks.workunit.client.0.smithi059.stdout:3 0 2024-09-16T16:52:08.375 INFO:tasks.workunit.client.0.smithi059.stdout:4 0 2024-09-16T16:52:08.375 INFO:tasks.workunit.client.0.smithi059.stdout:12 0 2024-09-16T16:52:08.375 INFO:tasks.workunit.client.0.smithi059.stdout:9 0 2024-09-16T16:52:08.375 INFO:tasks.workunit.client.0.smithi059.stdout:2 0 2024-09-16T16:52:08.471 INFO:tasks.workunit.client.0.smithi059.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-16T16:52:08.754 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.ListObjectsStart (693 ms) 2024-09-16T16:52:08.754 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-16T16:52:08.956 INFO:tasks.workunit.client.0.smithi059.stdout:x cursor=MIN 2024-09-16T16:52:09.055 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-16T16:52:09.055 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-16T16:52:09.055 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-16T16:52:09.056 INFO:tasks.workunit.client.0.smithi059.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-16T16:52:09.161 INFO:tasks.workunit.client.0.smithi059.stdout:FIRST> seek to MIN oid=1 2024-09-16T16:52:09.260 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-16T16:52:09.260 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:02547ec2:::1:head 2024-09-16T16:52:09.358 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:02547ec2:::1:head -> 1 2024-09-16T16:52:09.358 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-16T16:52:09.358 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:52ea6a34:::10:head 2024-09-16T16:52:09.425 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-16T16:52:09.425 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-16T16:52:09.425 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:566253c9:::13:head 2024-09-16T16:52:09.492 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:566253c9:::13:head -> 13 2024-09-16T16:52:09.492 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-16T16:52:09.492 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-16T16:52:09.556 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-16T16:52:09.556 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-16T16:52:09.556 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:62a1935d:::14:head 2024-09-16T16:52:09.617 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:62a1935d:::14:head -> 14 2024-09-16T16:52:09.617 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-16T16:52:09.617 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:6cac518f:::0:head 2024-09-16T16:52:09.674 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:6cac518f:::0:head -> 0 2024-09-16T16:52:09.674 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-16T16:52:09.674 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:863748b0:::15:head 2024-09-16T16:52:09.721 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:863748b0:::15:head -> 15 2024-09-16T16:52:09.722 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-16T16:52:09.722 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:89d3ae78:::11:head 2024-09-16T16:52:09.768 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-16T16:52:09.768 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-16T16:52:09.768 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:b29083e3:::5:head 2024-09-16T16:52:09.799 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:b29083e3:::5:head -> 5 2024-09-16T16:52:09.799 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-16T16:52:09.799 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-16T16:52:09.826 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-16T16:52:09.826 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-16T16:52:09.826 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-16T16:52:09.851 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-16T16:52:09.851 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-16T16:52:09.851 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:cfc208b3:::3:head 2024-09-16T16:52:09.873 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-16T16:52:09.873 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-16T16:52:09.873 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:d83876eb:::4:head 2024-09-16T16:52:09.889 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:d83876eb:::4:head -> 4 2024-09-16T16:52:09.889 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-16T16:52:09.889 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-16T16:52:09.904 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-16T16:52:09.904 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-16T16:52:09.904 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:e960b815:::9:head 2024-09-16T16:52:09.913 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:e960b815:::9:head -> 9 2024-09-16T16:52:09.913 INFO:tasks.workunit.client.0.smithi059.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-16T16:52:09.913 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:f905c69b:::2:head 2024-09-16T16:52:09.916 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:f905c69b:::2:head -> 2 2024-09-16T16:52:09.917 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:566253c9:::13:head 2024-09-16T16:52:09.917 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-16T16:52:09.985 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:566253c9:::13:head -> 13 2024-09-16T16:52:09.985 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=13 expected=13 2024-09-16T16:52:09.985 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-16T16:52:09.985 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-16T16:52:10.012 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-16T16:52:10.012 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=8 expected=8 2024-09-16T16:52:10.012 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:02547ec2:::1:head 2024-09-16T16:52:10.012 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-16T16:52:10.111 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:02547ec2:::1:head -> 1 2024-09-16T16:52:10.111 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=1 expected=1 2024-09-16T16:52:10.111 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-16T16:52:10.111 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-16T16:52:10.127 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-16T16:52:10.127 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=12 expected=12 2024-09-16T16:52:10.127 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:d83876eb:::4:head 2024-09-16T16:52:10.127 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-16T16:52:10.143 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:d83876eb:::4:head -> 4 2024-09-16T16:52:10.143 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=4 expected=4 2024-09-16T16:52:10.143 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:cfc208b3:::3:head 2024-09-16T16:52:10.143 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-16T16:52:10.165 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-16T16:52:10.165 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=3 expected=3 2024-09-16T16:52:10.165 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-16T16:52:10.165 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-16T16:52:10.190 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-16T16:52:10.190 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=6 expected=6 2024-09-16T16:52:10.190 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:6cac518f:::0:head 2024-09-16T16:52:10.190 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-16T16:52:10.248 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:6cac518f:::0:head -> 0 2024-09-16T16:52:10.248 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=0 expected=0 2024-09-16T16:52:10.248 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:52ea6a34:::10:head 2024-09-16T16:52:10.248 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-16T16:52:10.315 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-16T16:52:10.315 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=10 expected=10 2024-09-16T16:52:10.315 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:b29083e3:::5:head 2024-09-16T16:52:10.316 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-16T16:52:10.346 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:b29083e3:::5:head -> 5 2024-09-16T16:52:10.346 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=5 expected=5 2024-09-16T16:52:10.346 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:89d3ae78:::11:head 2024-09-16T16:52:10.346 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-16T16:52:10.392 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-16T16:52:10.392 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=11 expected=11 2024-09-16T16:52:10.392 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:863748b0:::15:head 2024-09-16T16:52:10.392 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-16T16:52:10.439 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:863748b0:::15:head -> 15 2024-09-16T16:52:10.439 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=15 expected=15 2024-09-16T16:52:10.440 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:f905c69b:::2:head 2024-09-16T16:52:10.440 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-16T16:52:10.442 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:f905c69b:::2:head -> 2 2024-09-16T16:52:10.443 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=2 expected=2 2024-09-16T16:52:10.443 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:e960b815:::9:head 2024-09-16T16:52:10.443 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-16T16:52:10.453 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:e960b815:::9:head -> 9 2024-09-16T16:52:10.453 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=9 expected=9 2024-09-16T16:52:10.453 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:62a1935d:::14:head 2024-09-16T16:52:10.453 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-16T16:52:10.513 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:62a1935d:::14:head -> 14 2024-09-16T16:52:10.514 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=14 expected=14 2024-09-16T16:52:10.514 INFO:tasks.workunit.client.0.smithi059.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-16T16:52:10.514 INFO:tasks.workunit.client.0.smithi059.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-16T16:52:10.577 INFO:tasks.workunit.client.0.smithi059.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-16T16:52:10.578 INFO:tasks.workunit.client.0.smithi059.stdout:: entry=7 expected=7 2024-09-16T16:52:10.869 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.ListObjectsCursor (2115 ms) 2024-09-16T16:52:10.869 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-16T16:52:11.460 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.EnumerateObjects (591 ms) 2024-09-16T16:52:11.460 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-16T16:52:11.664 INFO:tasks.workunit.client.0.smithi059.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-16T16:52:11.687 INFO:tasks.workunit.client.0.smithi059.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-16T16:52:11.708 INFO:tasks.workunit.client.0.smithi059.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-16T16:52:11.732 INFO:tasks.workunit.client.0.smithi059.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-16T16:52:11.753 INFO:tasks.workunit.client.0.smithi059.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-16T16:52:12.058 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (598 ms) 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from LibRadosList (5515 ms total) 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosListEC 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:70: Skipped 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-16T16:52:12.845 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:78: Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-16T16:52:12.847 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:12.847 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosListNP 2024-09-16T16:52:12.847 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-16T16:52:15.870 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosListNP.ListObjectsError (3026 ms) 2024-09-16T16:52:15.870 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosListNP (3026 ms total) 2024-09-16T16:52:15.870 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:15.870 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:15.870 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 11 tests from 3 test suites ran. (10925 ms total) 2024-09-16T16:52:15.870 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 8 tests. 2024-09-16T16:52:15.871 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-16T16:52:15.871 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-16T16:52:15.871 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-16T16:52:15.871 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-16T16:52:15.874 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:15.874 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:15.874 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_lock 2024-09-16T16:52:15.898 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:52:15.898 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T16:52:15.898 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:15.898 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLock 2024-09-16T16:52:17.880 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-16T16:52:18.193 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.LockExclusive (313 ms) 2024-09-16T16:52:18.193 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-16T16:52:18.220 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.LockShared (27 ms) 2024-09-16T16:52:18.220 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-16T16:52:19.265 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1045 ms) 2024-09-16T16:52:19.265 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-16T16:52:20.312 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.LockSharedDur (1048 ms) 2024-09-16T16:52:20.313 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-16T16:52:20.356 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.LockMayRenew (43 ms) 2024-09-16T16:52:20.356 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-16T16:52:20.404 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.Unlock (49 ms) 2024-09-16T16:52:20.404 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-16T16:52:20.467 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.ListLockers (62 ms) 2024-09-16T16:52:20.467 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-16T16:52:20.500 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLock.BreakLock (34 ms) 2024-09-16T16:52:20.898 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLock (2621 ms total) 2024-09-16T16:52:20.898 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.899 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (1 ms) 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.900 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-16T16:52:20.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:20.902 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLockEC (1 ms total) 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 16 tests from 2 test suites ran. (4998 ms total) 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 8 tests. 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-16T16:52:20.903 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-16T16:52:20.904 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:20.904 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:20.904 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_lock_pp 2024-09-16T16:52:20.920 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:52:20.920 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T16:52:20.920 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:20.920 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-16T16:52:20.920 INFO:tasks.workunit.client.0.smithi059.stdout:seed 31145 2024-09-16T16:52:22.905 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-16T16:52:23.166 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (262 ms) 2024-09-16T16:52:23.167 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-16T16:52:23.200 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.LockSharedPP (33 ms) 2024-09-16T16:52:23.200 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-16T16:52:24.249 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1050 ms) 2024-09-16T16:52:24.250 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-16T16:52:25.293 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1043 ms) 2024-09-16T16:52:25.293 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-16T16:52:25.339 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (46 ms) 2024-09-16T16:52:25.339 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-16T16:52:25.387 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.UnlockPP (48 ms) 2024-09-16T16:52:25.387 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-16T16:52:25.444 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.ListLockersPP (57 ms) 2024-09-16T16:52:25.444 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-16T16:52:25.494 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosLockPP.BreakLockPP (51 ms) 2024-09-16T16:52:25.916 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLockPP (2590 ms total) 2024-09-16T16:52:25.916 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:25.916 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-16T16:52:25.916 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:52:25.916 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-16T16:52:25.917 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-16T16:52:25.918 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.919 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-16T16:52:25.920 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 16 tests from 2 test suites ran. (4996 ms total) 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 8 tests. 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-16T16:52:25.921 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-16T16:52:25.922 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:25.922 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:25.922 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_misc 2024-09-16T16:52:25.970 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:25.967+0000 7f0541a866c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:25.971 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:25.969+0000 7f0541a866c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:25.971 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:25.969+0000 7f0541a866c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:25.972 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-16T16:52:25.973 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-16T16:52:26.040 INFO:tasks.workunit.client.0.smithi059.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-16T16:52:26.040 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:26.038+0000 7f0541a866c0 -1 failed for service _ceph-mon._tcp 2024-09-16T16:52:26.040 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:52:26.038+0000 7f0541a866c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-16T16:52:26.040 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (69 ms) 2024-09-16T16:52:26.040 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-16T16:52:31.053 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5013 ms) 2024-09-16T16:52:31.053 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5082 ms total) 2024-09-16T16:52:31.053 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:31.053 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-16T16:52:31.053 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-16T16:52:33.929 INFO:tasks.workunit.client.0.smithi059.stdout:started 0x7f0510005de0 2024-09-16T16:52:34.929 INFO:tasks.workunit.client.0.smithi059.stdout:started 0x7f051c005de0 2024-09-16T16:52:34.929 INFO:tasks.workunit.client.0.smithi059.stdout: started 2 aios 2024-09-16T16:52:34.929 INFO:tasks.workunit.client.0.smithi059.stdout:waiting 0x7f0510005de0 2024-09-16T16:52:34.929 INFO:tasks.workunit.client.0.smithi059.stdout:waiting 0x7f051c005de0 2024-09-16T16:52:34.934 INFO:tasks.workunit.client.0.smithi059.stdout:done. 2024-09-16T16:52:36.464 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5411 ms) 2024-09-16T16:52:36.464 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscPool (5411 ms total) 2024-09-16T16:52:36.464 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:52:36.464 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosMisc 2024-09-16T16:52:38.466 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-16T16:52:38.466 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-16T16:52:38.466 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-16T16:52:38.775 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.Exec (309 ms) 2024-09-16T16:52:38.775 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-16T16:52:38.827 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.WriteSame (53 ms) 2024-09-16T16:52:38.828 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-16T16:52:38.853 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.CmpExt (26 ms) 2024-09-16T16:52:38.853 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-16T16:52:43.495 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.Applications (4641 ms) 2024-09-16T16:52:43.495 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-16T16:52:43.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-16T16:52:43.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-16T16:52:43.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-16T16:52:43.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-16T16:53:12.327 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMisc.ShutdownRace (28832 ms) 2024-09-16T16:53:12.485 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 8 tests from LibRadosMisc (33861 ms total) 2024-09-16T16:53:12.485 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:12.485 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:53:12.486 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 12 tests from 4 test suites ran. (46514 ms total) 2024-09-16T16:53:12.486 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 12 tests. 2024-09-16T16:53:12.500 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:53:12.501 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:53:12.501 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_misc_pp 2024-09-16T16:53:12.555 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:53:12.554+0000 7f407cb31840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:12.555 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:53:12.554+0000 7f407cb31840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:12.555 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:53:12.554+0000 7f407cb31840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:12.555 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-16T16:53:12.556 INFO:tasks.workunit.client.0.smithi059.stdout:seed 92810 2024-09-16T16:53:14.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-16T16:53:14.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-16T16:53:14.496 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-16T16:53:14.939 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.LongNamePP (443 ms) 2024-09-16T16:53:14.939 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-16T16:53:14.939 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-16T16:53:14.939 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:14.939 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-16T16:53:14.940 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-16T16:53:15.002 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (64 ms) 2024-09-16T16:53:15.003 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-16T16:53:15.058 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (55 ms) 2024-09-16T16:53:15.058 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-16T16:53:15.077 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.ExecPP (19 ms) 2024-09-16T16:53:15.077 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-16T16:53:15.095 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (18 ms) 2024-09-16T16:53:15.095 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-16T16:53:15.127 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.Operate1PP (32 ms) 2024-09-16T16:53:15.127 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-16T16:53:15.145 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.Operate2PP (18 ms) 2024-09-16T16:53:15.145 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-16T16:53:15.193 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (48 ms) 2024-09-16T16:53:15.193 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-16T16:53:15.211 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (17 ms) 2024-09-16T16:53:15.211 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-16T16:53:15.237 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (26 ms) 2024-09-16T16:53:15.237 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-16T16:53:15.290 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (53 ms) 2024-09-16T16:53:15.290 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-16T16:53:15.303 INFO:tasks.workunit.client.0.smithi059.stdout:osd_max_attr_size = 0 2024-09-16T16:53:15.303 INFO:tasks.workunit.client.0.smithi059.stdout:osd_max_attr_size == 0; skipping test 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (19787 ms) 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-16T16:53:35.079 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-16T16:53:35.124 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (47 ms) 2024-09-16T16:53:35.124 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-16T16:53:35.151 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (27 ms) 2024-09-16T16:53:35.151 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.Applications (4331 ms) 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-16T16:53:39.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-16T16:53:40.488 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 22 tests from LibRadosMiscPP (24986 ms total) 2024-09-16T16:53:40.488 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:40.488 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-16T16:53:40.488 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-16T16:53:40.488 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:40.489 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-16T16:53:42.497 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-16T16:53:42.762 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosChecksum/0.Subset (266 ms) 2024-09-16T16:53:42.763 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-16T16:53:42.790 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosChecksum/0.Chunked (27 ms) 2024-09-16T16:53:43.506 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosChecksum/0 (293 ms total) 2024-09-16T16:53:43.506 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:43.506 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-16T16:53:45.514 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-16T16:53:45.830 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosChecksum/1.Subset (316 ms) 2024-09-16T16:53:45.830 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-16T16:53:45.852 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosChecksum/1.Chunked (22 ms) 2024-09-16T16:53:46.476 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosChecksum/1 (339 ms total) 2024-09-16T16:53:46.476 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:46.476 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-16T16:53:48.532 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-16T16:53:48.804 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosChecksum/2.Subset (272 ms) 2024-09-16T16:53:48.804 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-16T16:53:48.836 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosChecksum/2.Chunked (32 ms) 2024-09-16T16:53:49.540 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosChecksum/2 (304 ms total) 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:49.541 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 31 tests from 7 test suites ran. (36985 ms total) 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 26 tests. 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-16T16:53:49.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-16T16:53:49.544 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:53:49.544 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:53:49.544 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_tier_pp 2024-09-16T16:53:49.597 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-16T16:53:49.597 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:53:49.597 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-16T16:53:49.597 INFO:tasks.workunit.client.0.smithi059.stdout:seed 92882 2024-09-16T16:53:49.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:53:49.594+0000 7f6db9a3a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:53:49.594+0000 7f6db9a3a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.598 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:53:49.595+0000 7f6db9a3a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:51.555 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-16T16:53:51.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-16T16:53:51.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:51.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-16T16:53:51.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-16T16:53:51.557 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-16T16:53:51.557 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:51.557 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-16T16:53:51.557 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-16T16:53:51.557 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-16T16:53:51.558 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:51.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-16T16:53:52.570 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-16T16:53:52.571 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:52.571 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-16T16:53:54.576 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-16T16:53:54.576 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.576 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.576 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-16T16:53:54.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-16T16:53:54.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-16T16:53:54.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-16T16:53:54.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.588 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.589 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.590 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.591 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.592 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-16T16:53:54.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-16T16:53:54.592 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.592 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.594 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.595 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-16T16:53:54.596 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:54.597 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.598 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:54.598 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.598 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-16T16:53:55.574 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-09-16T16:53:55.574 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.577 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-16T16:53:55.579 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.580 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.581 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.582 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.583 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.584 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-16T16:53:55.585 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:55.587 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 77 tests from 4 test suites ran. (5976 ms total) 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 0 tests. 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-16T16:53:55.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-16T16:53:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-16T16:53:55.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-16T16:53:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-16T16:53:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-16T16:53:55.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-16T16:53:55.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-16T16:53:55.595 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:53:55.595 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:53:55.595 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_pool 2024-09-16T16:53:55.602 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:53:55.602 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-16T16:53:55.602 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:53:55.602 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 9 tests from LibRadosPools 2024-09-16T16:53:55.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-16T16:53:58.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolList (2880 ms) 2024-09-16T16:53:58.482 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-16T16:54:01.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolLookup (3027 ms) 2024-09-16T16:54:01.509 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-16T16:54:04.524 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolLookup2 (3015 ms) 2024-09-16T16:54:04.524 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-16T16:54:07.483 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (2960 ms) 2024-09-16T16:54:07.484 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-16T16:54:10.503 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3019 ms) 2024-09-16T16:54:10.503 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-16T16:54:15.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolDelete (5003 ms) 2024-09-16T16:54:15.506 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-16T16:54:20.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4987 ms) 2024-09-16T16:54:20.493 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-16T16:54:25.525 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5032 ms) 2024-09-16T16:54:25.525 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-16T16:54:25.525 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/pool.cc:139: Skipped 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 9 tests from LibRadosPools (29923 ms total) 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 9 tests from 1 test suite ran. (29923 ms total) 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 8 tests. 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T16:54:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-16T16:54:25.529 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:54:25.529 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:54:25.530 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_snapshots 2024-09-16T16:54:25.555 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:54:25.555 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-16T16:54:25.555 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:25.555 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-16T16:54:27.488 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-16T16:54:29.494 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshots.SnapList (2006 ms) 2024-09-16T16:54:29.494 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-16T16:54:31.512 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2018 ms) 2024-09-16T16:54:31.512 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-16T16:54:33.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshots.Rollback (2014 ms) 2024-09-16T16:54:33.526 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-16T16:54:35.537 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2011 ms) 2024-09-16T16:54:36.489 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosSnapshots (8049 ms total) 2024-09-16T16:54:36.489 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:54:36.490 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-16T16:54:38.495 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-16T16:54:42.564 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4070 ms) 2024-09-16T16:54:42.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-16T16:54:46.552 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (3987 ms) 2024-09-16T16:54:46.552 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-16T16:54:51.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5068 ms) 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13125 ms total) 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-16T16:54:52.561 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (1 ms) 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:52.562 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosSnapshotsEC (1 ms total) 2024-09-16T16:54:52.563 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:52.564 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 13 tests from 4 test suites ran. (27006 ms total) 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 7 tests. 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-16T16:54:52.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-16T16:54:52.566 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-16T16:54:52.566 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-16T16:54:52.566 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:54:52.566 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:54:52.566 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-16T16:54:52.588 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:54:52.589 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-16T16:54:52.589 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:52.589 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-16T16:54:52.589 INFO:tasks.workunit.client.0.smithi059.stdout:seed 93138 2024-09-16T16:54:54.570 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-16T16:54:56.494 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (1924 ms) 2024-09-16T16:54:56.494 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-16T16:54:58.499 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2005 ms) 2024-09-16T16:54:58.499 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-16T16:55:00.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2009 ms) 2024-09-16T16:55:00.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-16T16:55:02.525 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2016 ms) 2024-09-16T16:55:02.525 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-16T16:55:06.500 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3976 ms) 2024-09-16T16:55:07.501 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11930 ms total) 2024-09-16T16:55:07.501 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:07.501 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-16T16:55:09.508 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-16T16:55:13.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4075 ms) 2024-09-16T16:55:13.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-16T16:55:17.502 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3919 ms) 2024-09-16T16:55:17.503 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-16T16:55:23.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6015 ms) 2024-09-16T16:55:23.517 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-16T16:55:27.502 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3985 ms) 2024-09-16T16:55:27.502 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-16T16:55:29.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2078 ms) 2024-09-16T16:55:29.580 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-16T16:55:29.580 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-16T16:55:29.580 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:29.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-16T16:55:29.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-16T16:55:31.524 INFO:tasks.workunit.client.0.smithi059.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi059-93138-7 2024-09-16T16:55:32.523 INFO:tasks.workunit.client.0.smithi059.stdout:waiting for snaps to purge 2024-09-16T16:55:47.543 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17963 ms) 2024-09-16T16:55:48.520 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38035 ms total) 2024-09-16T16:55:48.520 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:48.520 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-16T16:55:48.520 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-16T16:55:48.527 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (7 ms) 2024-09-16T16:55:48.527 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-16T16:55:53.600 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5072 ms) 2024-09-16T16:55:53.600 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5079 ms total) 2024-09-16T16:55:53.600 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:53.600 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.601 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-16T16:55:53.603 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.604 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:55:53.605 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 21 tests from 5 test suites ran. (61010 ms total) 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 13 tests. 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-16T16:55:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-16T16:55:53.607 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-16T16:55:53.607 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:55:53.607 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:55:53.607 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_stat 2024-09-16T16:55:53.627 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:55:53.627 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-16T16:55:53.628 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:55:53.628 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from LibRadosStat 2024-09-16T16:55:55.542 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStat.Stat 2024-09-16T16:55:55.835 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStat.Stat (293 ms) 2024-09-16T16:55:55.835 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-16T16:55:55.895 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStat.Stat2 (60 ms) 2024-09-16T16:55:55.895 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-16T16:55:55.953 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStat.StatNS (58 ms) 2024-09-16T16:55:55.953 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-16T16:55:55.953 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-09-16T16:55:55.953 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-16T16:55:55.967 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStat.PoolStat (14 ms) 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from LibRadosStat (425 ms total) 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-16T16:55:56.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 9 tests from 2 test suites ran. (2926 ms total) 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 5 tests. 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T16:55:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-16T16:55:56.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-16T16:55:56.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-16T16:55:56.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-16T16:55:56.558 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:55:56.558 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:55:56.558 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_stat_pp 2024-09-16T16:55:56.584 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:55:56.584 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-16T16:55:56.584 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:55:56.584 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-16T16:55:56.584 INFO:tasks.workunit.client.0.smithi059.stdout:seed 93272 2024-09-16T16:55:58.566 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-16T16:55:58.886 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStatPP.StatPP (320 ms) 2024-09-16T16:55:58.887 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-16T16:55:58.912 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (25 ms) 2024-09-16T16:55:58.912 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-16T16:55:58.913 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-09-16T16:55:58.913 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-16T16:55:58.926 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStatPP.PoolStatPP (13 ms) 2024-09-16T16:55:58.926 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-16T16:55:58.990 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosStatPP.StatPPNS (64 ms) 2024-09-16T16:55:59.570 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from LibRadosStatPP (423 ms total) 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:59.571 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-16T16:55:59.572 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-16T16:55:59.573 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 9 tests from 2 test suites ran. (2985 ms total) 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 5 tests. 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-16T16:55:59.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-16T16:55:59.575 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:55:59.575 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:55:59.575 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_watch_notify 2024-09-16T16:55:59.596 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:55:59.597 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-16T16:55:59.597 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:55:59.597 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-16T16:56:01.511 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-16T16:56:01.799 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify_test_cb 2024-09-16T16:56:01.831 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (319 ms) 2024-09-16T16:56:01.831 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-16T16:56:01.893 INFO:tasks.workunit.client.0.smithi059.stdout:waiting up to 300 for disconnect notification ... 2024-09-16T16:56:04.654 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_errcb cookie 11385872 err -107 2024-09-16T16:56:04.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3070 ms) 2024-09-16T16:56:04.901 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-16T16:56:04.940 INFO:tasks.workunit.client.0.smithi059.stdout:waiting up to 300 for disconnect notification ... 2024-09-16T16:56:09.657 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_errcb cookie 11387120 err -107 2024-09-16T16:56:09.949 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5048 ms) 2024-09-16T16:56:09.949 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-16T16:56:09.984 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787584 cookie 11404800 2024-09-16T16:56:10.007 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (58 ms) 2024-09-16T16:56:10.007 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-16T16:56:10.040 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787584 cookie 11404800 2024-09-16T16:56:10.062 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (55 ms) 2024-09-16T16:56:10.062 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-16T16:56:10.093 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787585 cookie 11404800 2024-09-16T16:56:10.114 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.AioNotify (52 ms) 2024-09-16T16:56:10.114 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-16T16:56:10.159 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787584 cookie 11410128 2024-09-16T16:56:10.159 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787584 cookie 11416736 2024-09-16T16:56:10.190 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (76 ms) 2024-09-16T16:56:10.190 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-16T16:56:10.220 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787586 cookie 11416736 2024-09-16T16:56:13.221 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787587 cookie 11416736 2024-09-16T16:56:13.246 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3056 ms) 2024-09-16T16:56:13.246 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-16T16:56:13.278 INFO:tasks.workunit.client.0.smithi059.stdout:waiting up to 1024 for osd to time us out ... 2024-09-16T16:56:17.290 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_errcb cookie 11410128 err -107 2024-09-16T16:56:18.310 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_cb from 15462 notify_id 1735166787586 cookie 11410128 2024-09-16T16:56:18.329 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5084 ms) 2024-09-16T16:56:18.330 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-16T16:56:18.373 INFO:tasks.workunit.client.0.smithi059.stdout:waiting up to 30 for disconnect notification ... 2024-09-16T16:56:19.658 INFO:tasks.workunit.client.0.smithi059.stdout:watch_notify2_test_errcb cookie 11410128 err -107 2024-09-16T16:56:20.382 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2052 ms) 2024-09-16T16:56:20.527 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 10 tests from LibRadosWatchNotify (18871 ms total) 2024-09-16T16:56:20.527 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:20.527 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-16T16:56:20.527 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:56:20.527 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (1 ms) 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibRadosWatchNotifyEC (1 ms total) 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 11 tests from 2 test suites ran. (20930 ms total) 2024-09-16T16:56:20.528 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 10 tests. 2024-09-16T16:56:20.529 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T16:56:20.529 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-16T16:56:20.529 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:20.530 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:20.530 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-16T16:56:20.555 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:56:20.555 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T16:56:20.555 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:20.555 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-16T16:56:20.557 INFO:tasks.workunit.client.0.smithi059.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:56:20.557 INFO:tasks.workunit.client.0.smithi059.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.557 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-16T16:56:20.557 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:20.557 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-16T16:56:22.521 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-16T16:56:22.850 INFO:tasks.workunit.client.0.smithi059.stdout:notify 2024-09-16T16:56:22.866 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (346 ms) 2024-09-16T16:56:22.866 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-16T16:56:22.904 INFO:tasks.workunit.client.0.smithi059.stdout:notify 2024-09-16T16:56:22.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (53 ms) 2024-09-16T16:56:22.920 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-16T16:56:22.957 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (38 ms) 2024-09-16T16:56:22.957 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-16T16:56:23.000 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (42 ms) 2024-09-16T16:56:23.000 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-16T16:56:23.032 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8214560 notify_id 1748051689476 notifier_gid 15465 2024-09-16T16:56:23.048 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (48 ms) 2024-09-16T16:56:23.048 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-16T16:56:23.080 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8214560 notify_id 1748051689477 notifier_gid 15465 2024-09-16T16:56:23.096 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (48 ms) 2024-09-16T16:56:23.096 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-16T16:56:23.129 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8214560 notify_id 1748051689474 notifier_gid 15465 2024-09-16T16:56:23.145 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (49 ms) 2024-09-16T16:56:23.145 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-16T16:56:23.182 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8221040 notify_id 1748051689473 notifier_gid 15465 2024-09-16T16:56:23.199 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (55 ms) 2024-09-16T16:56:23.200 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-16T16:56:23.233 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8221040 notify_id 1748051689476 notifier_gid 15465 2024-09-16T16:56:23.248 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (49 ms) 2024-09-16T16:56:23.248 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-16T16:56:23.282 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8221040 notify_id 1748051689475 notifier_gid 15465 2024-09-16T16:56:23.297 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (49 ms) 2024-09-16T16:56:23.297 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-16T16:56:23.327 INFO:tasks.workunit.client.0.smithi059.stdout: trying... 2024-09-16T16:56:23.330 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8221040 notify_id 1748051689476 notifier_gid 15465 2024-09-16T16:56:24.329 INFO:tasks.workunit.client.0.smithi059.stdout: timed out 2024-09-16T16:56:24.342 INFO:tasks.workunit.client.0.smithi059.stdout: flushing 2024-09-16T16:56:26.331 INFO:tasks.workunit.client.0.smithi059.stdout: flushed 2024-09-16T16:56:26.331 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3033 ms) 2024-09-16T16:56:26.331 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-16T16:56:26.368 INFO:tasks.workunit.client.0.smithi059.stdout: trying... 2024-09-16T16:56:26.373 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8221040 notify_id 1748051689478 notifier_gid 15465 2024-09-16T16:56:27.371 INFO:tasks.workunit.client.0.smithi059.stdout: timed out 2024-09-16T16:56:27.386 INFO:tasks.workunit.client.0.smithi059.stdout: flushing 2024-09-16T16:56:29.373 INFO:tasks.workunit.client.0.smithi059.stdout: flushed 2024-09-16T16:56:29.373 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3042 ms) 2024-09-16T16:56:29.374 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-16T16:56:29.414 INFO:tasks.workunit.client.0.smithi059.stdout:List watches 2024-09-16T16:56:29.414 INFO:tasks.workunit.client.0.smithi059.stdout:notify2 2024-09-16T16:56:29.417 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8236800 notify_id 1748051689477 notifier_gid 15465 2024-09-16T16:56:32.424 INFO:tasks.workunit.client.0.smithi059.stdout:notify2 done 2024-09-16T16:56:32.424 INFO:tasks.workunit.client.0.smithi059.stdout:watch_check 2024-09-16T16:56:32.424 INFO:tasks.workunit.client.0.smithi059.stdout:unwatch2 2024-09-16T16:56:32.441 INFO:tasks.workunit.client.0.smithi059.stdout: flushing 2024-09-16T16:56:32.441 INFO:tasks.workunit.client.0.smithi059.stdout:done 2024-09-16T16:56:32.441 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3068 ms) 2024-09-16T16:56:32.441 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-16T16:56:32.478 INFO:tasks.workunit.client.0.smithi059.stdout:List watches 2024-09-16T16:56:32.478 INFO:tasks.workunit.client.0.smithi059.stdout:notify2 2024-09-16T16:56:32.482 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 8221040 notify_id 1752346656775 notifier_gid 15465 2024-09-16T16:56:35.488 INFO:tasks.workunit.client.0.smithi059.stdout:notify2 done 2024-09-16T16:56:35.489 INFO:tasks.workunit.client.0.smithi059.stdout:watch_check 2024-09-16T16:56:35.489 INFO:tasks.workunit.client.0.smithi059.stdout:unwatch2 2024-09-16T16:56:35.505 INFO:tasks.workunit.client.0.smithi059.stdout: flushing 2024-09-16T16:56:35.505 INFO:tasks.workunit.client.0.smithi059.stdout:done 2024-09-16T16:56:35.505 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3064 ms) 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12984 ms total) 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 16 tests from 2 test suites ran. (15358 ms total) 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 14 tests. 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-16T16:56:35.913 INFO:tasks.workunit.client.0.smithi059.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-16T16:56:35.915 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:35.915 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:35.915 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_cmd 2024-09-16T16:56:35.943 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:56:35.943 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:56:35.943 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:35.943 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosCmd 2024-09-16T16:56:35.943 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-16T16:56:36.020 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.MonDescribe (77 ms) 2024-09-16T16:56:36.020 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-16T16:56:36.088 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.OSDCmd (68 ms) 2024-09-16T16:56:36.088 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-16T16:56:38.523 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.PGCmd (2435 ms) 2024-09-16T16:56:38.524 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-16T16:56:38.561 INFO:tasks.workunit.client.0.smithi059.stdout:got: 2024-09-16T16:56:37.513720+0000 mon.a [INF] from='client.? 172.21.15.59:0/4086143260' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi059-93329-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-16T16:56:39.518 INFO:tasks.workunit.client.0.smithi059.stdout:got: 2024-09-16T16:56:38.560933+0000 client.admin [INF] onexx 2024-09-16T16:56:39.519 INFO:tasks.workunit.client.0.smithi059.stdout:got: 2024-09-16T16:56:38.561144+0000 mon.a [INF] from='client.? 172.21.15.59:0/1219407634' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-16T16:56:43.523 INFO:tasks.workunit.client.0.smithi059.stdout:got: 2024-09-16T16:56:41.522595+0000 mon.a [INF] from='client.? 172.21.15.59:0/1219407634' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-16T16:56:43.531 INFO:tasks.workunit.client.0.smithi059.stdout:got: 2024-09-16T16:56:43.523396+0000 client.admin [INF] threexx 2024-09-16T16:56:43.532 INFO:tasks.workunit.client.0.smithi059.stdout:got: 2024-09-16T16:56:43.523661+0000 mon.a [INF] from='client.? 172.21.15.59:0/1219407634' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-16T16:56:47.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.WatchLog (9014 ms) 2024-09-16T16:56:47.538 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosCmd (11595 ms total) 2024-09-16T16:56:47.538 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:47.538 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:47.538 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 4 tests from 1 test suite ran. (11595 ms total) 2024-09-16T16:56:47.538 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 4 tests. 2024-09-16T16:56:47.541 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:47.541 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:47.541 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-16T16:56:47.564 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:56:47.565 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T16:56:47.565 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:47.565 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosCmd 2024-09-16T16:56:47.565 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-16T16:56:47.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-09-16T16:56:47.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-16T16:56:47.639 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.OSDCmdPP (38 ms) 2024-09-16T16:56:47.640 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-16T16:56:49.733 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCmd.PGCmdPP (2093 ms) 2024-09-16T16:56:49.733 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from LibRadosCmd (2168 ms total) 2024-09-16T16:56:49.733 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:49.733 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:49.733 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 3 tests from 1 test suite ran. (2168 ms total) 2024-09-16T16:56:49.733 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 3 tests. 2024-09-16T16:56:49.735 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:49.735 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:49.735 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_service 2024-09-16T16:56:49.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:56:49.773+0000 7f9540032840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:49.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:56:49.773+0000 7f9540032840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:49.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:56:49.773+0000 7f9540032840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:49.774 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:56:49.774 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:49.775 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosService 2024-09-16T16:56:49.775 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-16T16:56:54.825 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosService.RegisterEarly (5051 ms) 2024-09-16T16:56:54.825 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-16T16:56:54.862 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosService.RegisterLate (37 ms) 2024-09-16T16:56:54.862 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-16T16:56:55.030 INFO:tasks.workunit.client.0.smithi059.stdout: cluster: 2024-09-16T16:56:55.030 INFO:tasks.workunit.client.0.smithi059.stdout: id: c43301f4-656b-4707-8343-bef82748353c 2024-09-16T16:56:55.030 INFO:tasks.workunit.client.0.smithi059.stdout: health: HEALTH_WARN 2024-09-16T16:56:55.030 INFO:tasks.workunit.client.0.smithi059.stdout: 1 pool(s) do not have an application enabled 2024-09-16T16:56:55.030 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:55.030 INFO:tasks.workunit.client.0.smithi059.stdout: services: 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: mgr: x(active, since 9m) 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 10m) 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: laundry: 1 daemon active (1 hosts) 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: data: 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: pools: 3 pools, 41 pgs 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: objects: 5 objects, 577 KiB 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: usage: 239 MiB used, 360 GiB / 360 GiB avail 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: pgs: 41 active+clean 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:55.031 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:57.061 INFO:tasks.workunit.client.0.smithi059.stdout: cluster: 2024-09-16T16:56:57.061 INFO:tasks.workunit.client.0.smithi059.stdout: id: c43301f4-656b-4707-8343-bef82748353c 2024-09-16T16:56:57.061 INFO:tasks.workunit.client.0.smithi059.stdout: health: HEALTH_WARN 2024-09-16T16:56:57.061 INFO:tasks.workunit.client.0.smithi059.stdout: 1 pool(s) do not have an application enabled 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: services: 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: mgr: x(active, since 10m) 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 10m) 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: data: 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: pools: 3 pools, 41 pgs 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: objects: 5 objects, 577 KiB 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: usage: 239 MiB used, 360 GiB / 360 GiB avail 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: pgs: 41 active+clean 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:57.062 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:56:57.088 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosService.StatusFormat (2226 ms) 2024-09-16T16:56:57.088 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosService.Status 2024-09-16T16:57:17.120 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosService.Status (20032 ms) 2024-09-16T16:57:17.121 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosService (27346 ms total) 2024-09-16T16:57:17.121 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:57:17.121 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:57:17.121 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 4 tests from 1 test suite ran. (27346 ms total) 2024-09-16T16:57:17.121 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 4 tests. 2024-09-16T16:57:17.126 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:57:17.126 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:57:17.126 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_service_pp 2024-09-16T16:57:17.164 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:57:17.163+0000 7f7f5204b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.164 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:57:17.163+0000 7f7f5204b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.164 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T16:57:17.164+0000 7f7f5204b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.165 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:57:17.165 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:57:17.165 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-16T16:57:17.165 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-16T16:57:22.195 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5030 ms) 2024-09-16T16:57:22.195 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-16T16:57:22.245 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosServicePP.RegisterLate (51 ms) 2024-09-16T16:57:22.246 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-16T16:57:42.278 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosServicePP.Status (20031 ms) 2024-09-16T16:57:42.278 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-16T16:57:42.278 INFO:tasks.workunit.client.0.smithi059.stdout:attempt 0 of 20 2024-09-16T16:57:47.340 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosServicePP.Close (5063 ms) 2024-09-16T16:57:47.340 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 4 tests from LibRadosServicePP (30175 ms total) 2024-09-16T16:57:47.340 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:57:47.340 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:57:47.340 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 4 tests from 1 test suite ran. (30175 ms total) 2024-09-16T16:57:47.340 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 4 tests. 2024-09-16T16:57:47.343 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:57:47.343 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:57:47.343 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-16T16:57:47.366 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-16T16:57:49.550 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.assertExists (2184 ms) 2024-09-16T16:57:49.551 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-16T16:57:52.571 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3021 ms) 2024-09-16T16:57:52.571 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-16T16:57:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3015 ms) 2024-09-16T16:57:55.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-16T16:57:58.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.Write (3016 ms) 2024-09-16T16:57:58.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-16T16:58:01.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.Exec (3024 ms) 2024-09-16T16:58:01.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-16T16:58:04.666 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3040 ms) 2024-09-16T16:58:04.666 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-16T16:58:15.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] LibRadosCWriteOps.CmpExt (10889 ms) 2024-09-16T16:58:15.556 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from LibRadosCWriteOps (28189 ms total) 2024-09-16T16:58:15.556 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:58:15.556 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:15.556 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 8 tests from 2 test suites ran. (28189 ms total) 2024-09-16T16:58:15.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 8 tests. 2024-09-16T16:58:15.558 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:15.558 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:15.558 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-16T16:58:15.580 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:15.580 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T16:58:15.580 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:15.580 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 17 tests from CReadOpsTest 2024-09-16T16:58:17.548 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-16T16:58:17.548 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-16T16:58:17.548 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-16T16:58:17.858 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.SetOpFlags (310 ms) 2024-09-16T16:58:17.858 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-16T16:58:17.893 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.AssertExists (35 ms) 2024-09-16T16:58:17.893 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-16T16:58:17.947 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.AssertVersion (54 ms) 2024-09-16T16:58:17.947 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-16T16:58:18.140 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.CmpXattr (193 ms) 2024-09-16T16:58:18.140 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.Read 2024-09-16T16:58:18.187 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.Read (47 ms) 2024-09-16T16:58:18.187 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-16T16:58:18.231 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.Checksum (45 ms) 2024-09-16T16:58:18.231 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-16T16:58:18.263 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.RWOrderedRead (31 ms) 2024-09-16T16:58:18.263 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-16T16:58:18.307 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.ShortRead (44 ms) 2024-09-16T16:58:18.307 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-16T16:58:18.337 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.Exec (30 ms) 2024-09-16T16:58:18.337 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-16T16:58:18.380 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.ExecUserBuf (43 ms) 2024-09-16T16:58:18.380 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-16T16:58:18.421 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.Stat (41 ms) 2024-09-16T16:58:18.421 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-16T16:58:18.461 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.Stat2 (40 ms) 2024-09-16T16:58:18.461 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-16T16:58:18.605 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.Omap (144 ms) 2024-09-16T16:58:18.605 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-16T16:58:18.704 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.OmapNuls (99 ms) 2024-09-16T16:58:18.704 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-16T16:58:18.786 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.GetXattrs (83 ms) 2024-09-16T16:58:18.787 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-16T16:58:18.825 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] CReadOpsTest.CmpExt (39 ms) 2024-09-16T16:58:19.554 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 17 tests from CReadOpsTest (1278 ms total) 2024-09-16T16:58:19.554 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:58:19.554 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:19.554 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 17 tests from 1 test suite ran. (3974 ms total) 2024-09-16T16:58:19.554 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 17 tests. 2024-09-16T16:58:19.557 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:19.557 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:19.557 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_list_parallel 2024-09-16T16:58:22.542 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: starting. 2024-09-16T16:58:22.542 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: creating pool ceph_test_rados_list_parallel.smithi059-94010 2024-09-16T16:58:22.543 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: created object 0... 2024-09-16T16:58:22.543 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: created object 25... 2024-09-16T16:58:22.543 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: created object 49... 2024-09-16T16:58:22.543 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: finishing. 2024-09-16T16:58:22.543 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94011]: shutting down. 2024-09-16T16:58:22.691 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94012]: starting. 2024-09-16T16:58:22.691 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94012]: listing objects. 2024-09-16T16:58:22.691 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94012]: listed object 0... 2024-09-16T16:58:22.691 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94012]: listed object 25... 2024-09-16T16:58:22.692 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94012]: saw 50 objects 2024-09-16T16:58:22.692 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94012]: shutting down. 2024-09-16T16:58:23.362 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:23.362 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: starting. 2024-09-16T16:58:23.362 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: creating pool ceph_test_rados_list_parallel.smithi059-94010 2024-09-16T16:58:23.362 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: created object 0... 2024-09-16T16:58:23.362 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: created object 25... 2024-09-16T16:58:23.363 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: created object 49... 2024-09-16T16:58:23.363 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: finishing. 2024-09-16T16:58:23.363 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94047]: shutting down. 2024-09-16T16:58:23.672 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94048]: starting. 2024-09-16T16:58:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94048]: listing objects. 2024-09-16T16:58:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94048]: listed object 0... 2024-09-16T16:58:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94048]: listed object 25... 2024-09-16T16:58:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94048]: saw 43 objects 2024-09-16T16:58:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94048]: shutting down. 2024-09-16T16:58:23.957 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:23.957 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94049]: starting. 2024-09-16T16:58:23.957 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94049]: removed 25 objects... 2024-09-16T16:58:23.958 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94049]: removed half of the objects 2024-09-16T16:58:23.958 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94049]: removed 50 objects... 2024-09-16T16:58:23.958 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94049]: removed 50 objects 2024-09-16T16:58:23.958 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94049]: shutting down. 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: starting. 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: creating pool ceph_test_rados_list_parallel.smithi059-94010 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: created object 0... 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: created object 25... 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: created object 49... 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: finishing. 2024-09-16T16:58:24.642 INFO:tasks.workunit.client.0.smithi059.stdout:process_6_[94098]: shutting down. 2024-09-16T16:58:25.003 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:25.003 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:25.003 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: starting. 2024-09-16T16:58:25.003 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: listing objects. 2024-09-16T16:58:25.003 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: listed object 0... 2024-09-16T16:58:25.003 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: listed object 25... 2024-09-16T16:58:25.004 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: listed object 50... 2024-09-16T16:58:25.004 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: saw 54 objects 2024-09-16T16:58:25.004 INFO:tasks.workunit.client.0.smithi059.stdout:process_7_[94099]: shutting down. 2024-09-16T16:58:25.337 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:25.337 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:25.337 INFO:tasks.workunit.client.0.smithi059.stdout:process_8_[94100]: starting. 2024-09-16T16:58:25.337 INFO:tasks.workunit.client.0.smithi059.stdout:process_8_[94100]: added 25 objects... 2024-09-16T16:58:25.338 INFO:tasks.workunit.client.0.smithi059.stdout:process_8_[94100]: added half of the objects 2024-09-16T16:58:25.338 INFO:tasks.workunit.client.0.smithi059.stdout:process_8_[94100]: added 50 objects... 2024-09-16T16:58:25.338 INFO:tasks.workunit.client.0.smithi059.stdout:process_8_[94100]: added 50 objects 2024-09-16T16:58:25.338 INFO:tasks.workunit.client.0.smithi059.stdout:process_8_[94100]: shutting down. 2024-09-16T16:58:26.032 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.032 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.032 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.032 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: starting. 2024-09-16T16:58:26.033 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: creating pool ceph_test_rados_list_parallel.smithi059-94010 2024-09-16T16:58:26.033 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: created object 0... 2024-09-16T16:58:26.033 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: created object 25... 2024-09-16T16:58:26.033 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: created object 49... 2024-09-16T16:58:26.033 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: finishing. 2024-09-16T16:58:26.033 INFO:tasks.workunit.client.0.smithi059.stdout:process_9_[94149]: shutting down. 2024-09-16T16:58:26.451 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.451 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.451 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.451 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: starting. 2024-09-16T16:58:26.451 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: listing objects. 2024-09-16T16:58:26.452 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: listed object 0... 2024-09-16T16:58:26.452 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: listed object 25... 2024-09-16T16:58:26.452 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: listed object 50... 2024-09-16T16:58:26.452 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: listed object 75... 2024-09-16T16:58:26.452 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: saw 99 objects 2024-09-16T16:58:26.452 INFO:tasks.workunit.client.0.smithi059.stdout:process_10_[94150]: shutting down. 2024-09-16T16:58:26.825 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.825 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.825 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.825 INFO:tasks.workunit.client.0.smithi059.stdout:process_13_[94153]: starting. 2024-09-16T16:58:26.825 INFO:tasks.workunit.client.0.smithi059.stdout:process_13_[94153]: removed 25 objects... 2024-09-16T16:58:26.825 INFO:tasks.workunit.client.0.smithi059.stdout:process_13_[94153]: removed half of the objects 2024-09-16T16:58:26.826 INFO:tasks.workunit.client.0.smithi059.stdout:process_13_[94153]: removed 50 objects... 2024-09-16T16:58:26.826 INFO:tasks.workunit.client.0.smithi059.stdout:process_13_[94153]: removed 50 objects 2024-09-16T16:58:26.826 INFO:tasks.workunit.client.0.smithi059.stdout:process_13_[94153]: shutting down. 2024-09-16T16:58:26.888 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:process_11_[94151]: starting. 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:process_11_[94151]: added 25 objects... 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:process_11_[94151]: added half of the objects 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:process_11_[94151]: added 50 objects... 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:process_11_[94151]: added 50 objects 2024-09-16T16:58:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:process_11_[94151]: shutting down. 2024-09-16T16:58:26.935 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:process_12_[94152]: starting. 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:process_12_[94152]: added 25 objects... 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:process_12_[94152]: added half of the objects 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:process_12_[94152]: added 50 objects... 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:process_12_[94152]: added 50 objects 2024-09-16T16:58:26.936 INFO:tasks.workunit.client.0.smithi059.stdout:process_12_[94152]: shutting down. 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: starting. 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: creating pool ceph_test_rados_list_parallel.smithi059-94010 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: created object 0... 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: created object 25... 2024-09-16T16:58:27.608 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: created object 49... 2024-09-16T16:58:27.609 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: finishing. 2024-09-16T16:58:27.609 INFO:tasks.workunit.client.0.smithi059.stdout:process_14_[94234]: shutting down. 2024-09-16T16:58:27.953 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.953 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.953 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: starting. 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listing objects. 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listed object 0... 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listed object 25... 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listed object 50... 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listed object 75... 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listed object 100... 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: listed object 125... 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: saw 150 objects 2024-09-16T16:58:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:process_15_[94235]: shutting down. 2024-09-16T16:58:28.277 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:process_16_[94236]: starting. 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:process_16_[94236]: added 25 objects... 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:process_16_[94236]: added half of the objects 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:process_16_[94236]: added 50 objects... 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:process_16_[94236]: added 50 objects 2024-09-16T16:58:28.278 INFO:tasks.workunit.client.0.smithi059.stdout:process_16_[94236]: shutting down. 2024-09-16T16:58:28.931 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.932 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.932 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.932 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.932 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:28.932 INFO:tasks.workunit.client.0.smithi059.stdout:******* SUCCESS ********** 2024-09-16T16:58:28.933 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:28.933 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:28.933 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-16T16:58:31.920 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: starting. 2024-09-16T16:58:31.920 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: creating pool ceph_test_rados_open_pools_parallel.smithi059-94302 2024-09-16T16:58:31.920 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: created object 0... 2024-09-16T16:58:31.920 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: created object 25... 2024-09-16T16:58:31.920 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: created object 49... 2024-09-16T16:58:31.921 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: finishing. 2024-09-16T16:58:31.921 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94303]: shutting down. 2024-09-16T16:58:32.556 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94304]: starting. 2024-09-16T16:58:32.556 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94304]: rados_pool_create. 2024-09-16T16:58:32.556 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94304]: rados_ioctx_create. 2024-09-16T16:58:32.557 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94304]: shutting down. 2024-09-16T16:58:35.530 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: starting. 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: creating pool ceph_test_rados_open_pools_parallel.smithi059-94302 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: created object 0... 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: created object 25... 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: created object 49... 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: finishing. 2024-09-16T16:58:35.531 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94339]: shutting down. 2024-09-16T16:58:35.565 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:35.565 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94340]: starting. 2024-09-16T16:58:35.565 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94340]: rados_pool_create. 2024-09-16T16:58:35.565 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94340]: rados_ioctx_create. 2024-09-16T16:58:35.565 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94340]: shutting down. 2024-09-16T16:58:35.567 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:35.567 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:35.567 INFO:tasks.workunit.client.0.smithi059.stdout:******* SUCCESS ********** 2024-09-16T16:58:35.568 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:35.568 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:35.568 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-16T16:58:38.529 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: starting. 2024-09-16T16:58:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: creating pool ceph_test_rados_delete_pools_parallel.smithi059-94375 2024-09-16T16:58:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: created object 0... 2024-09-16T16:58:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: created object 25... 2024-09-16T16:58:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: created object 49... 2024-09-16T16:58:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: finishing. 2024-09-16T16:58:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:process_1_[94376]: shutting down. 2024-09-16T16:58:38.586 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94377]: starting. 2024-09-16T16:58:38.586 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94377]: deleting pool ceph_test_rados_delete_pools_parallel.smithi059-94375 2024-09-16T16:58:38.586 INFO:tasks.workunit.client.0.smithi059.stdout:process_2_[94377]: shutting down. 2024-09-16T16:58:41.546 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: starting. 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: creating pool ceph_test_rados_delete_pools_parallel.smithi059-94375 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: created object 0... 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: created object 25... 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: created object 49... 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: finishing. 2024-09-16T16:58:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:process_3_[94412]: shutting down. 2024-09-16T16:58:41.699 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:41.700 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94414]: starting. 2024-09-16T16:58:41.700 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94414]: listing objects. 2024-09-16T16:58:41.700 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94414]: listed object 0... 2024-09-16T16:58:41.700 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94414]: listed object 25... 2024-09-16T16:58:41.700 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94414]: saw 50 objects 2024-09-16T16:58:41.700 INFO:tasks.workunit.client.0.smithi059.stdout:process_5_[94414]: shutting down. 2024-09-16T16:58:42.614 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:42.614 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94413]: starting. 2024-09-16T16:58:42.614 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94413]: deleting pool ceph_test_rados_delete_pools_parallel.smithi059-94375 2024-09-16T16:58:42.615 INFO:tasks.workunit.client.0.smithi059.stdout:process_4_[94413]: shutting down. 2024-09-16T16:58:42.616 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:42.616 INFO:tasks.workunit.client.0.smithi059.stdout:******************************* 2024-09-16T16:58:42.617 INFO:tasks.workunit.client.0.smithi059.stdout:******* SUCCESS ********** 2024-09-16T16:58:42.618 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:58:42.618 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:42.618 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:58:42.618 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' cls = ec_io ']' 2024-09-16T16:58:42.618 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' cls = ec_list ']' 2024-09-16T16:58:42.618 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_cls 2024-09-16T16:58:42.644 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:42.644 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T16:58:42.644 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:42.644 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from NeoRadosCls 2024-09-16T16:58:42.644 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-16T16:58:45.623 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosCls.DNE (2979 ms) 2024-09-16T16:58:45.623 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from NeoRadosCls (2979 ms total) 2024-09-16T16:58:45.623 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:58:45.623 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:45.623 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 1 test from 1 test suite ran. (2979 ms total) 2024-09-16T16:58:45.623 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 1 test. 2024-09-16T16:58:45.626 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:58:45.626 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:45.626 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:58:45.626 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' cmd = ec_io ']' 2024-09-16T16:58:45.626 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' cmd = ec_list ']' 2024-09-16T16:58:45.626 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_cmd 2024-09-16T16:58:45.650 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:45.650 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T16:58:45.650 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:45.650 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-16T16:58:45.650 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-16T16:58:47.634 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosCmd.MonDescribe (1984 ms) 2024-09-16T16:58:47.634 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-16T16:58:49.640 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosCmd.OSDCmd (2006 ms) 2024-09-16T16:58:49.641 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-16T16:58:52.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosCmd.PGCmd (2918 ms) 2024-09-16T16:58:52.558 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from NeoRadosCmd (6908 ms total) 2024-09-16T16:58:52.558 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:58:52.558 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:52.558 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 3 tests from 1 test suite ran. (6908 ms total) 2024-09-16T16:58:52.558 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 3 tests. 2024-09-16T16:58:52.561 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:58:52.561 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:52.561 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:58:52.561 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' handler_error = ec_io ']' 2024-09-16T16:58:52.561 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' handler_error = ec_list ']' 2024-09-16T16:58:52.561 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_handler_error 2024-09-16T16:58:52.582 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:52.582 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T16:58:52.582 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:52.582 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from neocls_handler_error 2024-09-16T16:58:52.582 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-16T16:58:55.569 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] neocls_handler_error.test_handler_error (2987 ms) 2024-09-16T16:58:55.569 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 1 test from neocls_handler_error (2987 ms total) 2024-09-16T16:58:55.569 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:58:55.569 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:55.569 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 1 test from 1 test suite ran. (2987 ms total) 2024-09-16T16:58:55.569 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 1 test. 2024-09-16T16:58:55.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:58:55.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:55.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:58:55.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' io = ec_io ']' 2024-09-16T16:58:55.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' io = ec_list ']' 2024-09-16T16:58:55.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_io 2024-09-16T16:58:55.595 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:55.595 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-16T16:58:55.595 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:55.595 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from NeoRadosIo 2024-09-16T16:58:55.595 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-16T16:58:56.553 INFO:tasks.workunit.client.0.smithi059.stderr:Not supported by crimson yet. Skipped 2024-09-16T16:58:57.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.Limits (1961 ms) 2024-09-16T16:58:57.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-16T16:59:00.572 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.SimpleWrite (3016 ms) 2024-09-16T16:59:00.572 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-16T16:59:03.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.ReadOp (3021 ms) 2024-09-16T16:59:03.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-16T16:59:06.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.SparseRead (2963 ms) 2024-09-16T16:59:06.556 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-16T16:59:09.566 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.RoundTrip (3010 ms) 2024-09-16T16:59:09.566 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-16T16:59:12.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3028 ms) 2024-09-16T16:59:12.594 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-16T16:59:15.612 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3018 ms) 2024-09-16T16:59:15.612 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-16T16:59:18.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (2963 ms) 2024-09-16T16:59:18.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-16T16:59:21.588 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3013 ms) 2024-09-16T16:59:21.589 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-16T16:59:24.608 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.Trunc (3020 ms) 2024-09-16T16:59:24.608 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-16T16:59:27.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.Remove (3012 ms) 2024-09-16T16:59:27.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-16T16:59:30.634 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3014 ms) 2024-09-16T16:59:30.634 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-16T16:59:33.645 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.RmXattr (3011 ms) 2024-09-16T16:59:33.645 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-16T16:59:36.566 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosIo.GetXattrs (2922 ms) 2024-09-16T16:59:36.567 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from NeoRadosIo (40972 ms total) 2024-09-16T16:59:36.567 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:59:36.567 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:59:36.567 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 14 tests from 1 test suite ran. (40972 ms total) 2024-09-16T16:59:36.567 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 14 tests. 2024-09-16T16:59:36.571 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:36.571 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:36.572 INFO:tasks.workunit.client.0.smithi059.stdout:Skipping EC with Crimson 2024-09-16T16:59:36.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:36.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' ec_io = ec_io ']' 2024-09-16T16:59:36.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ echo 'Skipping EC with Crimson' 2024-09-16T16:59:36.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ continue 2024-09-16T16:59:36.572 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:36.573 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:36.573 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:36.573 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' list = ec_io ']' 2024-09-16T16:59:36.573 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' list = ec_list ']' 2024-09-16T16:59:36.573 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_list 2024-09-16T16:59:36.596 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:59:36.596 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T16:59:36.596 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:59:36.596 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from NeoradosList 2024-09-16T16:59:36.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-16T16:59:39.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoradosList.ListObjects (2978 ms) 2024-09-16T16:59:39.574 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-16T16:59:42.600 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoradosList.ListObjectsNS (3026 ms) 2024-09-16T16:59:42.600 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-16T16:59:51.949 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoradosList.ListObjectsMany (9349 ms) 2024-09-16T16:59:51.949 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 3 tests from NeoradosList (15353 ms total) 2024-09-16T16:59:51.950 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T16:59:51.950 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T16:59:51.950 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 3 tests from 1 test suite ran. (15353 ms total) 2024-09-16T16:59:51.950 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 3 tests. 2024-09-16T16:59:51.952 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:51.952 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:51.952 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:51.952 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' ec_list = ec_io ']' 2024-09-16T16:59:51.952 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' ec_list = ec_list ']' 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stdout:Skipping EC with Crimson 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stderr:+ echo 'Skipping EC with Crimson' 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stderr:+ continue 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:51.953 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' misc = ec_io ']' 2024-09-16T16:59:51.954 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' misc = ec_list ']' 2024-09-16T16:59:51.954 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_misc 2024-09-16T16:59:51.975 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T16:59:51.975 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-16T16:59:51.975 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T16:59:51.975 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-16T16:59:51.975 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-16T16:59:53.954 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.Version (1979 ms) 2024-09-16T16:59:53.954 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-16T16:59:55.977 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2023 ms) 2024-09-16T16:59:55.977 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-16T16:59:58.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.LongName (2598 ms) 2024-09-16T16:59:58.575 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-16T16:59:59.580 INFO:tasks.workunit.client.0.smithi059.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:00:00.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.LongLocator (2015 ms) 2024-09-16T17:00:00.590 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-16T17:00:03.598 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.LongNamespace (3008 ms) 2024-09-16T17:00:03.598 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-16T17:00:06.571 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.LongAttrName (2973 ms) 2024-09-16T17:00:06.571 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-16T17:00:09.625 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.Exec (3055 ms) 2024-09-16T17:00:09.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-16T17:00:12.643 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.Operate1 (3017 ms) 2024-09-16T17:00:12.643 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-16T17:00:15.658 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.Operate2 (3015 ms) 2024-09-16T17:00:15.658 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-16T17:00:18.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.BigObject (2925 ms) 2024-09-16T17:00:18.583 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-16T17:00:20.600 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.BigAttr (2017 ms) 2024-09-16T17:00:20.600 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-16T17:00:21.602 INFO:tasks.workunit.client.0.smithi059.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:00:22.607 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosMisc.WriteSame (2007 ms) 2024-09-16T17:00:22.607 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 12 tests from NeoRadosMisc (30632 ms total) 2024-09-16T17:00:22.607 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:00:22.607 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T17:00:22.607 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 12 tests from 1 test suite ran. (30632 ms total) 2024-09-16T17:00:22.607 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 12 tests. 2024-09-16T17:00:22.612 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:00:22.612 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:00:22.612 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:00:22.612 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' pool = ec_io ']' 2024-09-16T17:00:22.612 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' pool = ec_list ']' 2024-09-16T17:00:22.612 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_pool 2024-09-16T17:00:22.636 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T17:00:22.636 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-16T17:00:22.636 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T17:00:22.637 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 6 tests from NeoRadosPools 2024-09-16T17:00:22.637 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-16T17:00:24.618 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosPools.PoolList (1982 ms) 2024-09-16T17:00:24.619 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-16T17:00:26.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosPools.PoolLookup (1960 ms) 2024-09-16T17:00:26.578 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-16T17:00:28.639 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2061 ms) 2024-09-16T17:00:28.639 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-16T17:00:32.659 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosPools.PoolDelete (4020 ms) 2024-09-16T17:00:32.659 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-16T17:00:34.669 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2010 ms) 2024-09-16T17:00:34.669 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-16T17:00:36.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (1911 ms) 2024-09-16T17:00:36.581 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 6 tests from NeoRadosPools (13944 ms total) 2024-09-16T17:00:36.581 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:00:36.581 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T17:00:36.581 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 6 tests from 1 test suite ran. (13944 ms total) 2024-09-16T17:00:36.581 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 6 tests. 2024-09-16T17:00:36.584 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:00:36.584 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:00:36.584 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:00:36.585 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' read_operations = ec_io ']' 2024-09-16T17:00:36.585 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' read_operations = ec_list ']' 2024-09-16T17:00:36.585 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_read_operations 2024-09-16T17:00:36.609 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T17:00:36.609 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-16T17:00:36.610 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T17:00:36.610 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-16T17:00:36.610 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-16T17:00:39.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2977 ms) 2024-09-16T17:00:39.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-16T17:00:42.603 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.AssertExists (3016 ms) 2024-09-16T17:00:42.603 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-16T17:00:45.624 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3020 ms) 2024-09-16T17:00:45.624 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-16T17:00:48.601 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.CmpXattr (2978 ms) 2024-09-16T17:00:48.601 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-16T17:00:51.610 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.Read (3009 ms) 2024-09-16T17:00:51.610 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-16T17:00:54.625 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.Checksum (3015 ms) 2024-09-16T17:00:54.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-16T17:00:57.638 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3013 ms) 2024-09-16T17:00:57.638 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-16T17:01:00.654 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.ShortRead (3016 ms) 2024-09-16T17:01:00.655 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-16T17:01:03.667 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.Exec (3013 ms) 2024-09-16T17:01:03.667 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-16T17:01:06.586 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.Stat (2919 ms) 2024-09-16T17:01:06.587 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-16T17:01:09.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.Omap (3007 ms) 2024-09-16T17:01:09.593 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-16T17:01:12.622 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3029 ms) 2024-09-16T17:01:12.622 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-16T17:01:15.628 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3006 ms) 2024-09-16T17:01:15.628 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-16T17:01:18.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosReadOps.CmpExt (2969 ms) 2024-09-16T17:01:18.597 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 14 tests from NeoRadosReadOps (41987 ms total) 2024-09-16T17:01:18.597 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:01:18.597 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T17:01:18.597 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 14 tests from 1 test suite ran. (41987 ms total) 2024-09-16T17:01:18.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 14 tests. 2024-09-16T17:01:18.602 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:01:18.602 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:01:18.602 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:01:18.602 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' snapshots = ec_io ']' 2024-09-16T17:01:18.602 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' snapshots = ec_list ']' 2024-09-16T17:01:18.602 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_snapshots 2024-09-16T17:01:18.626 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T17:01:18.626 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-16T17:01:18.626 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T17:01:18.626 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-16T17:01:18.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-16T17:01:23.625 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSnapshots.SnapList (4999 ms) 2024-09-16T17:01:23.625 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-16T17:01:28.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4977 ms) 2024-09-16T17:01:28.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-16T17:01:32.625 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSnapshots.Rollback (4023 ms) 2024-09-16T17:01:32.625 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-16T17:01:37.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (4972 ms) 2024-09-16T17:01:37.597 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-16T17:01:44.647 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7050 ms) 2024-09-16T17:01:44.647 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 5 tests from NeoRadosSnapshots (26021 ms total) 2024-09-16T17:01:44.648 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:01:44.648 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-16T17:01:44.648 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-16T17:01:49.664 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5017 ms) 2024-09-16T17:01:49.664 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-16T17:01:50.687 INFO:tasks.workunit.client.0.smithi059.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:01:51.685 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2021 ms) 2024-09-16T17:01:51.685 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-16T17:01:52.701 INFO:tasks.workunit.client.0.smithi059.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:01:53.701 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2016 ms) 2024-09-16T17:01:53.701 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-16T17:01:59.602 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5901 ms) 2024-09-16T17:01:59.603 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-16T17:02:03.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4024 ms) 2024-09-16T17:02:03.626 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-16T17:02:06.602 INFO:tasks.workunit.client.0.smithi059.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi059-95323-11. 2024-09-16T17:02:07.602 INFO:tasks.workunit.client.0.smithi059.stdout:Waiting for snaps to purge. 2024-09-16T17:02:23.614 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19987 ms) 2024-09-16T17:02:23.614 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38966 ms total) 2024-09-16T17:02:23.614 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:02:23.614 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T17:02:23.614 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 11 tests from 2 test suites ran. (64987 ms total) 2024-09-16T17:02:23.614 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 11 tests. 2024-09-16T17:02:23.619 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:02:23.619 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:02:23.619 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:02:23.619 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' watch_notify = ec_io ']' 2024-09-16T17:02:23.619 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' watch_notify = ec_list ']' 2024-09-16T17:02:23.619 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_watch_notify 2024-09-16T17:02:23.643 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T17:02:23.643 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T17:02:23.643 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T17:02:23.643 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-16T17:02:23.643 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-16T17:02:25.880 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 32231616 notify_id 2851858284550 notifier_gid 15863 2024-09-16T17:02:26.608 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2965 ms) 2024-09-16T17:02:26.608 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-16T17:02:28.970 INFO:tasks.workunit.client.0.smithi059.stdout:Trying... 2024-09-16T17:02:28.975 INFO:tasks.workunit.client.0.smithi059.stdout:handle_notify cookie 44939648 notify_id 2864743186434 notifier_gid 15866 2024-09-16T17:02:28.975 INFO:tasks.workunit.client.0.smithi059.stdout:Waiting for 3.000000000s 2024-09-16T17:02:29.975 INFO:tasks.workunit.client.0.smithi059.stdout:Timed out. 2024-09-16T17:02:29.989 INFO:tasks.workunit.client.0.smithi059.stdout:Flushing... 2024-09-16T17:02:29.990 INFO:tasks.workunit.client.0.smithi059.stdout:Flushed... 2024-09-16T17:02:33.645 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7037 ms) 2024-09-16T17:02:33.646 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 2 tests from NeoRadosWatchNotify (10002 ms total) 2024-09-16T17:02:33.646 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:02:33.646 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T17:02:33.646 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 2 tests from 1 test suite ran. (10002 ms total) 2024-09-16T17:02:33.646 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 2 tests. 2024-09-16T17:02:33.648 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:02:33.648 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:02:33.648 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:02:33.648 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' write_operations = ec_io ']' 2024-09-16T17:02:33.648 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' write_operations = ec_list ']' 2024-09-16T17:02:33.648 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph_test_neorados_write_operations 2024-09-16T17:02:33.673 INFO:tasks.workunit.client.0.smithi059.stdout:Running main() from gmock_main.cc 2024-09-16T17:02:33.673 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:02:33.673 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment set-up. 2024-09-16T17:02:33.674 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-16T17:02:33.674 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-16T17:02:36.610 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2937 ms) 2024-09-16T17:02:36.611 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-16T17:02:39.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3009 ms) 2024-09-16T17:02:39.620 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-16T17:02:42.651 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3031 ms) 2024-09-16T17:02:42.652 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-16T17:02:45.664 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.Write (3012 ms) 2024-09-16T17:02:45.664 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-16T17:02:48.627 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.Exec (2963 ms) 2024-09-16T17:02:48.628 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-16T17:02:51.641 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3014 ms) 2024-09-16T17:02:51.642 INFO:tasks.workunit.client.0.smithi059.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-16T17:03:02.630 INFO:tasks.workunit.client.0.smithi059.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10989 ms) 2024-09-16T17:03:02.630 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] 7 tests from NeoRadosWriteOps (28957 ms total) 2024-09-16T17:03:02.630 INFO:tasks.workunit.client.0.smithi059.stdout: 2024-09-16T17:03:02.630 INFO:tasks.workunit.client.0.smithi059.stdout:[----------] Global test environment tear-down 2024-09-16T17:03:02.630 INFO:tasks.workunit.client.0.smithi059.stdout:[==========] 7 tests from 1 test suite ran. (28957 ms total) 2024-09-16T17:03:02.631 INFO:tasks.workunit.client.0.smithi059.stdout:[ PASSED ] 7 tests. 2024-09-16T17:03:02.633 INFO:tasks.workunit.client.0.smithi059.stderr:+ ret=0 2024-09-16T17:03:02.633 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:03:02.633 INFO:tasks.workunit.client.0.smithi059.stderr:+ exit 0 2024-09-16T17:03:02.633 INFO:tasks.workunit.client.0.smithi059.stderr:+ cleanup 2024-09-16T17:03:02.634 INFO:tasks.workunit.client.0.smithi059.stderr:+ pkill -P 29749 2024-09-16T17:03:02.664 INFO:tasks.workunit.client.0.smithi059.stderr:+ true 2024-09-16T17:03:02.665 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T17:03:02.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T17:03:02.745 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-16T17:03:02.747 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-16T17:03:02.747 DEBUG:teuthology.orchestra.run.smithi059:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-16T17:03:02.811 INFO:tasks.workunit.client.0.smithi059.stderr:++ uuidgen 2024-09-16T17:03:02.814 INFO:tasks.workunit.client.0.smithi059.stderr:+ p=91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:03:02.814 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool create 91fcba37-be76-447c-b31c-498d24e0adc8 12 2024-09-16T17:03:02.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.945+0000 7f03f1751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:02.957 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.957+0000 7f03f1751640 1 Processor -- start 2024-09-16T17:03:02.957 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.957+0000 7f03f1751640 1 -- start start 2024-09-16T17:03:02.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03f1751640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03ec09ef30 0x7f03ec136060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:02.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03f1751640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec09f680 con 0x7f03ec1365a0 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03f1751640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec0a0120 con 0x7f03ec09ef30 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03eaffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03ec09ef30 0x7f03ec136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03eaffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03ec09ef30 0x7f03ec136060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54078/0 (socket says 172.21.15.59:54078) 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03eaffd640 1 -- 172.21.15.59:0/2960582392 learned_addr learned my addr 172.21.15.59:0/2960582392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03eaffd640 1 -- 172.21.15.59:0/2960582392 >> v1:172.21.15.59:6789/0 conn(0x7f03ec1365a0 legacy=0x7f03ec09d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.959+0000 7f03e9ffb640 1 -- 172.21.15.59:0/2960582392 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104199929 0 0) 0x7f03ec09f680 con 0x7f03ec1365a0 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.960+0000 7f03eaffd640 1 -- 172.21.15.59:0/2960582392 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec09f340 con 0x7f03ec09ef30 2024-09-16T17:03:02.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.960+0000 7f03eaffd640 1 --2- 172.21.15.59:0/2960582392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec136060 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66996e272bb97dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:02.962 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.960+0000 7f03e9ffb640 1 -- 172.21.15.59:0/2960582392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f03dc009e40 con 0x7f03ec09ef30 2024-09-16T17:03:02.962 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.960+0000 7f03e9ffb640 1 -- 172.21.15.59:0/2960582392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f03dc00e230 con 0x7f03ec09ef30 2024-09-16T17:03:02.962 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.960+0000 7f03e9ffb640 1 -- 172.21.15.59:0/2960582392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f03dc00e4d0 con 0x7f03ec09ef30 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 -- 172.21.15.59:0/2960582392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 msgr2=0x7f03ec136060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 --2- 172.21.15.59:0/2960582392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec136060 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 -- 172.21.15.59:0/2960582392 shutdown_connections 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 --2- 172.21.15.59:0/2960582392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec136060 unknown :-1 s=CLOSED pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 -- 172.21.15.59:0/2960582392 >> 172.21.15.59:0/2960582392 conn(0x7f03ec0a65b0 msgr2=0x7f03ec0a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 -- 172.21.15.59:0/2960582392 shutdown_connections 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 1 -- 172.21.15.59:0/2960582392 wait complete. 2024-09-16T17:03:02.963 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.961+0000 7f03f1751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:02.964 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.963+0000 7f03f1751640 1 Processor -- start 2024-09-16T17:03:02.964 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.964+0000 7f03f1751640 1 -- start start 2024-09-16T17:03:02.966 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.965+0000 7f03f1751640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:02.966 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.965+0000 7f03f1751640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec135da0 con 0x7f03ec09ef30 2024-09-16T17:03:02.966 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.965+0000 7f03eaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:02.966 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.965+0000 7f03eaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec123270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54090/0 (socket says 172.21.15.59:54090) 2024-09-16T17:03:02.967 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.965+0000 7f03eaffd640 1 -- 172.21.15.59:0/4134520629 learned_addr learned my addr 172.21.15.59:0/4134520629 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:02.967 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03eaffd640 1 -- 172.21.15.59:0/4134520629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec1267c0 con 0x7f03ec09ef30 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03eaffd640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec123270 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f03dc00ee10 con 0x7f03ec09ef30 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f03dc015420 con 0x7f03ec09ef30 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec122890 con 0x7f03ec09ef30 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f03dc0156c0 con 0x7f03ec09ef30 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.966+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec125280 con 0x7f03ec09ef30 2024-09-16T17:03:02.968 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.967+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec136060 con 0x7f03ec09ef30 2024-09-16T17:03:02.969 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.968+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f03dc015870 con 0x7f03ec09ef30 2024-09-16T17:03:02.969 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.968+0000 7f03d37fe640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f03d803e930 0x7f03d8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:02.969 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.968+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(693..693 src has 403..693) ==== 3431+0+0 (crc 0 0 0) 0x7f03dc051060 con 0x7f03ec09ef30 2024-09-16T17:03:02.969 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.969+0000 7f03ea7fc640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f03d803e930 0x7f03d8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:02.970 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.969+0000 7f03ea7fc640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f03d803e930 0x7f03d8040e40 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:02.975 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:02.974+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f03dc010a00 con 0x7f03ec09ef30 2024-09-16T17:03:03.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.170+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pg_num": 12} v 0) -- 0x7f03ec077d00 con 0x7f03ec09ef30 2024-09-16T17:03:03.621 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.620+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pg_num": 12}]=0 pool '91fcba37-be76-447c-b31c-498d24e0adc8' created v694) ==== 176+0+0 (crc 0 0 0) 0x7f03dc010310 con 0x7f03ec09ef30 2024-09-16T17:03:03.765 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.764+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pg_num": 12} v 0) -- 0x7f03ec124fd0 con 0x7f03ec09ef30 2024-09-16T17:03:03.765 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.764+0000 7f03d37fe640 1 -- 172.21.15.59:0/4134520629 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pg_num": 12}]=0 pool '91fcba37-be76-447c-b31c-498d24e0adc8' already exists v694) ==== 183+0+0 (crc 0 0 0) 0x7f03dc010310 con 0x7f03ec09ef30 2024-09-16T17:03:03.765 INFO:tasks.workunit.client.0.smithi059.stderr:pool '91fcba37-be76-447c-b31c-498d24e0adc8' already exists 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f03d803e930 msgr2=0x7f03d8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f03d803e930 0x7f03d8040e40 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 msgr2=0x7f03ec123270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec123270 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 shutdown_connections 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f03d803e930 0x7f03d8040e40 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 --2- 172.21.15.59:0/4134520629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ec09ef30 0x7f03ec123270 unknown :-1 s=CLOSED pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 >> 172.21.15.59:0/4134520629 conn(0x7f03ec0a65b0 msgr2=0x7f03ec0a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 shutdown_connections 2024-09-16T17:03:03.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.767+0000 7f03f1751640 1 -- 172.21.15.59:0/4134520629 wait complete. 2024-09-16T17:03:03.777 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_objects 10 2024-09-16T17:03:03.876 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.866+0000 7f6af7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:03.877 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.876+0000 7f6af7511640 1 Processor -- start 2024-09-16T17:03:03.877 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.876+0000 7f6af7511640 1 -- start start 2024-09-16T17:03:03.879 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af7511640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6af006e6e0 0x7f6af006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af7511640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af006dd50 con 0x7f6af0136070 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af7511640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6af006e290 con 0x7f6af006e6e0 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af52ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6af006e6e0 0x7f6af006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af52ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6af006e6e0 0x7f6af006eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54092/0 (socket says 172.21.15.59:54092) 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af52ad640 1 -- 172.21.15.59:0/342675670 learned_addr learned my addr 172.21.15.59:0/342675670 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af4aac640 1 --1- 172.21.15.59:0/342675670 >> v1:172.21.15.59:6789/0 conn(0x7f6af0136070 0x7f6af0136480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34994/0 (socket says 172.21.15.59:34994) 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af52ad640 1 -- 172.21.15.59:0/342675670 >> v1:172.21.15.59:6789/0 conn(0x7f6af0136070 legacy=0x7f6af0136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af52ad640 1 -- 172.21.15.59:0/342675670 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af006f590 con 0x7f6af006e6e0 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.878+0000 7f6af52ad640 1 --2- 172.21.15.59:0/342675670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af006eaf0 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4635d673584e24db server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6ae7fff640 1 -- 172.21.15.59:0/342675670 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6aec009d70 con 0x7f6af006e6e0 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6ae7fff640 1 -- 172.21.15.59:0/342675670 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6aec009ed0 con 0x7f6af006e6e0 2024-09-16T17:03:03.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6ae7fff640 1 -- 172.21.15.59:0/342675670 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6aec00e360 con 0x7f6af006e6e0 2024-09-16T17:03:03.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 -- 172.21.15.59:0/342675670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 msgr2=0x7f6af006eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:03.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 --2- 172.21.15.59:0/342675670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af006eaf0 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 -- 172.21.15.59:0/342675670 shutdown_connections 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 --2- 172.21.15.59:0/342675670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af006eaf0 unknown :-1 s=CLOSED pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 -- 172.21.15.59:0/342675670 >> 172.21.15.59:0/342675670 conn(0x7f6af00a31b0 msgr2=0x7f6af00a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 -- 172.21.15.59:0/342675670 shutdown_connections 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.879+0000 7f6af7511640 1 -- 172.21.15.59:0/342675670 wait complete. 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.880+0000 7f6af7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.881+0000 7f6af7511640 1 Processor -- start 2024-09-16T17:03:03.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.881+0000 7f6af7511640 1 -- start start 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.883+0000 7f6af7511640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af01cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.883+0000 7f6af7511640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0121dd0 con 0x7f6af006e6e0 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.883+0000 7f6af52ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af01cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.883+0000 7f6af52ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af01cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54104/0 (socket says 172.21.15.59:54104) 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.883+0000 7f6af52ad640 1 -- 172.21.15.59:0/3232214041 learned_addr learned my addr 172.21.15.59:0/3232214041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.883+0000 7f6af52ad640 1 -- 172.21.15.59:0/3232214041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af011fd10 con 0x7f6af006e6e0 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.884+0000 7f6af52ad640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af01cac40 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.884+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6aec00ed10 con 0x7f6af006e6e0 2024-09-16T17:03:03.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.884+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6aec00ee70 con 0x7f6af006e6e0 2024-09-16T17:03:03.886 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.884+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af01213b0 con 0x7f6af006e6e0 2024-09-16T17:03:03.886 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.884+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6aec015550 con 0x7f6af006e6e0 2024-09-16T17:03:03.886 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.884+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af011f970 con 0x7f6af006e6e0 2024-09-16T17:03:03.886 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.885+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af0070290 con 0x7f6af006e6e0 2024-09-16T17:03:03.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.885+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6aec015750 con 0x7f6af006e6e0 2024-09-16T17:03:03.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.885+0000 7f6ae5ffb640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6ad403e910 0x7f6ad4040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:03.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.886+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(694..694 src has 403..694) ==== 3806+0+0 (crc 0 0 0) 0x7f6aec050fa0 con 0x7f6af006e6e0 2024-09-16T17:03:03.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.886+0000 7f6af4aac640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6ad403e910 0x7f6ad4040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:03.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.886+0000 7f6af4aac640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6ad403e910 0x7f6ad4040e20 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:03.891 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:03.891+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6aec010a00 con 0x7f6af006e6e0 2024-09-16T17:03:04.078 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:04.078+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "10"} v 0) -- 0x7f6af01bdf80 con 0x7f6af006e6e0 2024-09-16T17:03:04.632 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:04.631+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v695) ==== 223+0+0 (crc 0 0 0) 0x7f6aec0059f0 con 0x7f6af006e6e0 2024-09-16T17:03:04.813 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:04.812+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "10"} v 0) -- 0x7f6af00008d0 con 0x7f6af006e6e0 2024-09-16T17:03:05.637 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.636+0000 7f6ae5ffb640 1 -- 172.21.15.59:0/3232214041 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v696) ==== 223+0+0 (crc 0 0 0) 0x7f6aec011df0 con 0x7f6af006e6e0 2024-09-16T17:03:05.637 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_objects = 10 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6ad403e910 msgr2=0x7f6ad4040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6ad403e910 0x7f6ad4040e20 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 msgr2=0x7f6af01cac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af01cac40 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 shutdown_connections 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6ad403e910 0x7f6ad4040e20 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:05.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 --2- 172.21.15.59:0/3232214041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6af006e6e0 0x7f6af01cac40 unknown :-1 s=CLOSED pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:05.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 >> 172.21.15.59:0/3232214041 conn(0x7f6af00a31b0 msgr2=0x7f6af01be510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:05.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 shutdown_connections 2024-09-16T17:03:05.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.641+0000 7f6af7511640 1 -- 172.21.15.59:0/3232214041 wait complete. 2024-09-16T17:03:05.655 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool application enable 91fcba37-be76-447c-b31c-498d24e0adc8 rados 2024-09-16T17:03:05.765 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.755+0000 7f782a951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:05.766 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.765+0000 7f782a951640 1 Processor -- start 2024-09-16T17:03:05.766 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.765+0000 7f782a951640 1 -- start start 2024-09-16T17:03:05.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f782a951640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f782409d1c0 0x7f7824138530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:05.768 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f782a951640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782409eb70 con 0x7f782409c6a0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f782a951640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f7824076180 con 0x7f782409d1c0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f7823fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f782409c6a0 0x7f782409cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35002/0 (socket says 172.21.15.59:35002) 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f78237fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f782409d1c0 0x7f7824138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f7823fff640 1 -- 172.21.15.59:0/786820878 learned_addr learned my addr 172.21.15.59:0/786820878 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f78237fe640 1 -- 172.21.15.59:0/786820878 >> v1:172.21.15.59:6789/0 conn(0x7f782409c6a0 legacy=0x7f782409cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.767+0000 7f78237fe640 1 -- 172.21.15.59:0/786820878 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782409e290 con 0x7f782409d1c0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f78237fe640 1 --2- 172.21.15.59:0/786820878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409d1c0 0x7f7824138530 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c837086e893c594d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f7822ffd640 1 -- 172.21.15.59:0/786820878 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7818009d90 con 0x7f782409d1c0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f7822ffd640 1 -- 172.21.15.59:0/786820878 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f781800e230 con 0x7f782409d1c0 2024-09-16T17:03:05.769 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f7822ffd640 1 -- 172.21.15.59:0/786820878 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f781800e4d0 con 0x7f782409d1c0 2024-09-16T17:03:05.770 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f782a951640 1 -- 172.21.15.59:0/786820878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409d1c0 msgr2=0x7f7824138530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:05.770 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f782a951640 1 --2- 172.21.15.59:0/786820878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409d1c0 0x7f7824138530 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:05.770 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.768+0000 7f782a951640 1 -- 172.21.15.59:0/786820878 shutdown_connections 2024-09-16T17:03:05.770 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.769+0000 7f782a951640 1 --2- 172.21.15.59:0/786820878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409d1c0 0x7f7824138530 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:05.770 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.769+0000 7f782a951640 1 -- 172.21.15.59:0/786820878 >> 172.21.15.59:0/786820878 conn(0x7f78240a30a0 msgr2=0x7f78240a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:05.771 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.769+0000 7f782a951640 1 -- 172.21.15.59:0/786820878 shutdown_connections 2024-09-16T17:03:05.771 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.769+0000 7f782a951640 1 -- 172.21.15.59:0/786820878 wait complete. 2024-09-16T17:03:05.771 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.769+0000 7f782a951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:05.772 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.771+0000 7f782a951640 1 Processor -- start 2024-09-16T17:03:05.772 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.771+0000 7f782a951640 1 -- start start 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.772+0000 7f782a951640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 0x7f78241324c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.772+0000 7f782a951640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7824130db0 con 0x7f782409c6a0 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7823fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 0x7f78241324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7823fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 0x7f78241324c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54116/0 (socket says 172.21.15.59:54116) 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7823fff640 1 -- 172.21.15.59:0/495040158 learned_addr learned my addr 172.21.15.59:0/495040158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7823fff640 1 -- 172.21.15.59:0/495040158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78241340d0 con 0x7f782409c6a0 2024-09-16T17:03:05.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7823fff640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 0x7f78241324c0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7814005a60 con 0x7f782409c6a0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7814005bc0 con 0x7f782409c6a0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782412fcc0 con 0x7f782409c6a0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7814005e60 con 0x7f782409c6a0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.773+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7824130570 con 0x7f782409c6a0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.774+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7824051040 con 0x7f782409c6a0 2024-09-16T17:03:05.775 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.774+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f781400c7f0 con 0x7f782409c6a0 2024-09-16T17:03:05.776 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.775+0000 7f7820ff9640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f781003e930 0x7f7810040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:05.776 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.775+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(696..696 src has 403..696) ==== 3806+0+0 (crc 0 0 0) 0x7f781404fae0 con 0x7f782409c6a0 2024-09-16T17:03:05.776 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.775+0000 7f78237fe640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f781003e930 0x7f7810040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:05.776 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.776+0000 7f78237fe640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f781003e930 0x7f7810040e40 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:05.780 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.780+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f781400dc10 con 0x7f782409c6a0 2024-09-16T17:03:05.970 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:05.969+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "app": "rados"} v 0) -- 0x7f782409f2b0 con 0x7f782409c6a0 2024-09-16T17:03:06.641 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:06.640+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "app": "rados"}]=0 enabled application 'rados' on pool '91fcba37-be76-447c-b31c-498d24e0adc8' v697) ==== 213+0+0 (crc 0 0 0) 0x7f781400d610 con 0x7f782409c6a0 2024-09-16T17:03:06.772 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:06.772+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "app": "rados"} v 0) -- 0x7f7824074620 con 0x7f782409c6a0 2024-09-16T17:03:07.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.641+0000 7f7820ff9640 1 -- 172.21.15.59:0/495040158 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "app": "rados"}]=0 enabled application 'rados' on pool '91fcba37-be76-447c-b31c-498d24e0adc8' v698) ==== 213+0+0 (crc 0 0 0) 0x7f781400d7f0 con 0x7f782409c6a0 2024-09-16T17:03:07.642 INFO:tasks.workunit.client.0.smithi059.stderr:enabled application 'rados' on pool '91fcba37-be76-447c-b31c-498d24e0adc8' 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.644+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f781003e930 msgr2=0x7f7810040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.644+0000 7f782a951640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f781003e930 0x7f7810040e40 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.644+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 msgr2=0x7f78241324c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.644+0000 7f782a951640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 0x7f78241324c0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.645+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 shutdown_connections 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.645+0000 7f782a951640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f781003e930 0x7f7810040e40 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.645+0000 7f782a951640 1 --2- 172.21.15.59:0/495040158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782409c6a0 0x7f78241324c0 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.645+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 >> 172.21.15.59:0/495040158 conn(0x7f78240a30a0 msgr2=0x7f78240732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.645+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 shutdown_connections 2024-09-16T17:03:07.646 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.645+0000 7f782a951640 1 -- 172.21.15.59:0/495040158 wait complete. 2024-09-16T17:03:07.667 INFO:tasks.workunit.client.0.smithi059.stderr:++ seq 1 10 2024-09-16T17:03:07.679 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:07.679 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj1 /etc/passwd 2024-09-16T17:03:07.720 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.719+0000 7eff628feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.726 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.725+0000 7eff628feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.726 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.725+0000 7eff628feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.727 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.726+0000 7eff628feec0 1 Processor -- start 2024-09-16T17:03:07.727 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.726+0000 7eff628feec0 1 -- start start 2024-09-16T17:03:07.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff628feec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1cd2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff628feec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1c3a520 con 0x1d68a60 2024-09-16T17:03:07.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff5ad9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1cd2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff5ad9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1cd2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54122/0 (socket says 172.21.15.59:54122) 2024-09-16T17:03:07.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff5ad9b640 1 -- 172.21.15.59:0/263043472 learned_addr learned my addr 172.21.15.59:0/263043472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff5ad9b640 1 -- 172.21.15.59:0/263043472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1bd6e10 con 0x1d68a60 2024-09-16T17:03:07.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff5ad9b640 1 --2- 172.21.15.59:0/263043472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1cd2810 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dca0cb700eab8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.728+0000 7eff59598640 1 -- 172.21.15.59:0/263043472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff4c00c490 con 0x1d68a60 2024-09-16T17:03:07.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff59598640 1 -- 172.21.15.59:0/263043472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7eff4c00c5f0 con 0x1d68a60 2024-09-16T17:03:07.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff59598640 1 -- 172.21.15.59:0/263043472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff4c00c890 con 0x1d68a60 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 -- 172.21.15.59:0/263043472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 msgr2=0x1cd2810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 --2- 172.21.15.59:0/263043472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1cd2810 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 -- 172.21.15.59:0/263043472 shutdown_connections 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 --2- 172.21.15.59:0/263043472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1cd2810 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 -- 172.21.15.59:0/263043472 >> 172.21.15.59:0/263043472 conn(0x1bfa770 msgr2=0x1d66380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 -- 172.21.15.59:0/263043472 shutdown_connections 2024-09-16T17:03:07.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.729+0000 7eff628feec0 1 -- 172.21.15.59:0/263043472 wait complete. 2024-09-16T17:03:07.732 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.730+0000 7eff628feec0 1 Processor -- start 2024-09-16T17:03:07.732 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.730+0000 7eff628feec0 1 -- start start 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff628feec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1d53550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff628feec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1c38280 con 0x1d68a60 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff5ad9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1d53550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff5ad9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1d53550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54126/0 (socket says 172.21.15.59:54126) 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff5ad9b640 1 -- 172.21.15.59:0/1934130197 learned_addr learned my addr 172.21.15.59:0/1934130197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff5ad9b640 1 -- 172.21.15.59:0/1934130197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1bc8920 con 0x1d68a60 2024-09-16T17:03:07.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.732+0000 7eff5ad9b640 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1d53550 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.733+0000 7eff53fff640 1 -- 172.21.15.59:0/1934130197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff4c0111e0 con 0x1d68a60 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.733+0000 7eff53fff640 1 -- 172.21.15.59:0/1934130197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7eff4c011a30 con 0x1d68a60 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.733+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1bc8380 con 0x1d68a60 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.733+0000 7eff53fff640 1 -- 172.21.15.59:0/1934130197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff4c011ba0 con 0x1d68a60 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.733+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1cd3f70 con 0x1d68a60 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.734+0000 7eff53fff640 1 -- 172.21.15.59:0/1934130197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7eff4c00f450 con 0x1d68a60 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.734+0000 7eff53fff640 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7eff3403d170 0x7eff3403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.734+0000 7eff53fff640 1 -- 172.21.15.59:0/1934130197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7eff4c050090 con 0x1d68a60 2024-09-16T17:03:07.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.734+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> v2:172.21.15.59:6800/3457013714 conn(0x1d6b890 0x2201ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.734+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1d56b60 con 0x1d6b890 2024-09-16T17:03:07.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.734+0000 7eff5a59a640 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7eff3403d170 0x7eff3403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.735+0000 7eff5a59a640 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7eff3403d170 0x7eff3403f680 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.735+0000 7eff5b59c640 1 --2- 172.21.15.59:0/1934130197 >> v2:172.21.15.59:6800/3457013714 conn(0x1d6b890 0x2201ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:07.739 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.739+0000 7eff5b59c640 1 --2- 172.21.15.59:0/1934130197 >> v2:172.21.15.59:6800/3457013714 conn(0x1d6b890 0x2201ab0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.756 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff5b59c640 1 -- 172.21.15.59:0/1934130197 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff4400a430 con 0x1d6b890 2024-09-16T17:03:07.756 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 >> v2:172.21.15.59:6800/3457013714 conn(0x1d6b890 msgr2=0x2201ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.756 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> v2:172.21.15.59:6800/3457013714 conn(0x1d6b890 0x2201ab0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.756 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7eff3403d170 msgr2=0x7eff3403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.756 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7eff3403d170 0x7eff3403f680 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 msgr2=0x1d53550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1d53550 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 shutdown_connections 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> v2:172.21.15.59:6800/3457013714 conn(0x1d6b890 0x2201ab0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7eff3403d170 0x7eff3403f680 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 --2- 172.21.15.59:0/1934130197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d68a60 0x1d53550 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 >> 172.21.15.59:0/1934130197 conn(0x1bfa770 msgr2=0x1d66170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 shutdown_connections 2024-09-16T17:03:07.757 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.755+0000 7eff628feec0 1 -- 172.21.15.59:0/1934130197 wait complete. 2024-09-16T17:03:07.759 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:07.759 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj2 /etc/passwd 2024-09-16T17:03:07.797 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.796+0000 7f7175922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.803 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.802+0000 7f7175922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.803 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.802+0000 7f7175922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.804 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.803+0000 7f7175922ec0 1 Processor -- start 2024-09-16T17:03:07.804 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.803+0000 7f7175922ec0 1 -- start start 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.804+0000 7f7175922ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x19a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.804+0000 7f7175922ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x190a520 con 0x1a389b0 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.804+0000 7f716dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x19a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.804+0000 7f716dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x19a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54146/0 (socket says 172.21.15.59:54146) 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.804+0000 7f716dd9b640 1 -- 172.21.15.59:0/234954608 learned_addr learned my addr 172.21.15.59:0/234954608 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.805+0000 7f716dd9b640 1 -- 172.21.15.59:0/234954608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18a6e10 con 0x1a389b0 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.805+0000 7f716dd9b640 1 --2- 172.21.15.59:0/234954608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x19a99b0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f05541a31964dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.805+0000 7f7167fff640 1 -- 172.21.15.59:0/234954608 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f71580061f0 con 0x1a389b0 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.805+0000 7f7167fff640 1 -- 172.21.15.59:0/234954608 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7158001980 con 0x1a389b0 2024-09-16T17:03:07.806 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.805+0000 7f7167fff640 1 -- 172.21.15.59:0/234954608 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7158001af0 con 0x1a389b0 2024-09-16T17:03:07.807 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 -- 172.21.15.59:0/234954608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 msgr2=0x19a99b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 --2- 172.21.15.59:0/234954608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x19a99b0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 -- 172.21.15.59:0/234954608 shutdown_connections 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 --2- 172.21.15.59:0/234954608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x19a99b0 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 -- 172.21.15.59:0/234954608 >> 172.21.15.59:0/234954608 conn(0x18ca770 msgr2=0x19a1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 -- 172.21.15.59:0/234954608 shutdown_connections 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.806+0000 7f7175922ec0 1 -- 172.21.15.59:0/234954608 wait complete. 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.807+0000 7f7175922ec0 1 Processor -- start 2024-09-16T17:03:07.808 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.807+0000 7f7175922ec0 1 -- start start 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.808+0000 7f7175922ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x1a24e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.808+0000 7f7175922ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1908280 con 0x1a389b0 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f716dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x1a24e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f716dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x1a24e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54160/0 (socket says 172.21.15.59:54160) 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f716dd9b640 1 -- 172.21.15.59:0/3127119622 learned_addr learned my addr 172.21.15.59:0/3127119622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f716dd9b640 1 -- 172.21.15.59:0/3127119622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1898920 con 0x1a389b0 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f716dd9b640 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x1a24e70 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.810 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f7166ffd640 1 -- 172.21.15.59:0/3127119622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7158011c10 con 0x1a389b0 2024-09-16T17:03:07.811 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f7166ffd640 1 -- 172.21.15.59:0/3127119622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7158011d70 con 0x1a389b0 2024-09-16T17:03:07.811 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1898380 con 0x1a389b0 2024-09-16T17:03:07.811 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f7166ffd640 1 -- 172.21.15.59:0/3127119622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7158012460 con 0x1a389b0 2024-09-16T17:03:07.811 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.809+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a25e00 con 0x1a389b0 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.810+0000 7f7166ffd640 1 -- 172.21.15.59:0/3127119622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7158012610 con 0x1a389b0 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.810+0000 7f7166ffd640 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f715403d1c0 0x7f715403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.810+0000 7f7166ffd640 1 -- 172.21.15.59:0/3127119622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7f715804f970 con 0x1a389b0 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.811+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> v2:172.21.15.104:6808/851587968 conn(0x1a394d0 0x1acdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.811+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1a276f0 con 0x1a394d0 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.811+0000 7f716d59a640 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f715403d1c0 0x7f715403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.812 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.811+0000 7f716d59a640 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f715403d1c0 0x7f715403f6d0 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.813 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.812+0000 7f716e59c640 1 --2- 172.21.15.59:0/3127119622 >> v2:172.21.15.104:6808/851587968 conn(0x1a394d0 0x1acdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:07.816 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.815+0000 7f716e59c640 1 --2- 172.21.15.59:0/3127119622 >> v2:172.21.15.104:6808/851587968 conn(0x1a394d0 0x1acdcf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.831 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f716e59c640 1 -- 172.21.15.59:0/3127119622 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f716000c430 con 0x1a394d0 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 >> v2:172.21.15.104:6808/851587968 conn(0x1a394d0 msgr2=0x1acdcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> v2:172.21.15.104:6808/851587968 conn(0x1a394d0 0x1acdcf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f715403d1c0 msgr2=0x7f715403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f715403d1c0 0x7f715403f6d0 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 msgr2=0x1a24e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x1a24e70 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 shutdown_connections 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> v2:172.21.15.104:6808/851587968 conn(0x1a394d0 0x1acdcf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f715403d1c0 0x7f715403f6d0 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 --2- 172.21.15.59:0/3127119622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a389b0 0x1a24e70 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 >> 172.21.15.59:0/3127119622 conn(0x18ca770 msgr2=0x19a1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 shutdown_connections 2024-09-16T17:03:07.833 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.830+0000 7f7175922ec0 1 -- 172.21.15.59:0/3127119622 wait complete. 2024-09-16T17:03:07.833 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:07.834 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj3 /etc/passwd 2024-09-16T17:03:07.871 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.870+0000 7f0b09f31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.877 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.876+0000 7f0b09f31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.877 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.876+0000 7f0b09f31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.878 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.877+0000 7f0b09f31ec0 1 Processor -- start 2024-09-16T17:03:07.878 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.877+0000 7f0b09f31ec0 1 -- start start 2024-09-16T17:03:07.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b09f31ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x8d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b09f31ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x836520 con 0x8c9fc0 2024-09-16T17:03:07.880 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b0283f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x8d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b0283f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x8d68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54174/0 (socket says 172.21.15.59:54174) 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b0283f640 1 -- 172.21.15.59:0/1500995782 learned_addr learned my addr 172.21.15.59:0/1500995782 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b0283f640 1 -- 172.21.15.59:0/1500995782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7d2e10 con 0x8c9fc0 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.879+0000 7f0b0283f640 1 --2- 172.21.15.59:0/1500995782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x8d68e0 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a3988d665c8f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b0103c640 1 -- 172.21.15.59:0/1500995782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aec02dcc0 con 0x8c9fc0 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b0103c640 1 -- 172.21.15.59:0/1500995782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0aec037370 con 0x8c9fc0 2024-09-16T17:03:07.881 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b0103c640 1 -- 172.21.15.59:0/1500995782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aec037610 con 0x8c9fc0 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1500995782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 msgr2=0x8d68e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1500995782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x8d68e0 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1500995782 shutdown_connections 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1500995782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x8d68e0 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1500995782 >> 172.21.15.59:0/1500995782 conn(0x7f6770 msgr2=0x8cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1500995782 shutdown_connections 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.880+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1500995782 wait complete. 2024-09-16T17:03:07.882 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.881+0000 7f0b09f31ec0 1 Processor -- start 2024-09-16T17:03:07.883 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.881+0000 7f0b09f31ec0 1 -- start start 2024-09-16T17:03:07.884 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b09f31ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x9d8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b09f31ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x834280 con 0x8c9fc0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b0283f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x9d8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b0283f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x9d8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54176/0 (socket says 172.21.15.59:54176) 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b0283f640 1 -- 172.21.15.59:0/1917748748 learned_addr learned my addr 172.21.15.59:0/1917748748 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b0283f640 1 -- 172.21.15.59:0/1917748748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7c4920 con 0x8c9fc0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.883+0000 7f0b0283f640 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x9d8fd0 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.884+0000 7f0afbfff640 1 -- 172.21.15.59:0/1917748748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aec037610 con 0x8c9fc0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.884+0000 7f0afbfff640 1 -- 172.21.15.59:0/1917748748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0aec02db90 con 0x8c9fc0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.884+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7c4380 con 0x8c9fc0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.884+0000 7f0afbfff640 1 -- 172.21.15.59:0/1917748748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aec039580 con 0x8c9fc0 2024-09-16T17:03:07.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.884+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x9db060 con 0x8c9fc0 2024-09-16T17:03:07.886 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.885+0000 7f0afbfff640 1 -- 172.21.15.59:0/1917748748 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0aec039780 con 0x8c9fc0 2024-09-16T17:03:07.886 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.885+0000 7f0afbfff640 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f0ae803d170 0x7f0ae803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.885+0000 7f0afbfff640 1 -- 172.21.15.59:0/1917748748 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7f0aec032040 con 0x8c9fc0 2024-09-16T17:03:07.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.885+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> v2:172.21.15.59:6800/3457013714 conn(0x8d2130 0x9eb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.885+0000 7f0b0203e640 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f0ae803d170 0x7f0ae803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.885+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x9dc850 con 0x8d2130 2024-09-16T17:03:07.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.886+0000 7f0b0203e640 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f0ae803d170 0x7f0ae803f680 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.887 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.886+0000 7f0b03040640 1 --2- 172.21.15.59:0/1917748748 >> v2:172.21.15.59:6800/3457013714 conn(0x8d2130 0x9eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:07.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.888+0000 7f0b03040640 1 --2- 172.21.15.59:0/1917748748 >> v2:172.21.15.59:6800/3457013714 conn(0x8d2130 0x9eb360 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.905 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b03040640 1 -- 172.21.15.59:0/1917748748 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0af400a430 con 0x8d2130 2024-09-16T17:03:07.905 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 >> v2:172.21.15.59:6800/3457013714 conn(0x8d2130 msgr2=0x9eb360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.905 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> v2:172.21.15.59:6800/3457013714 conn(0x8d2130 0x9eb360 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.905 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f0ae803d170 msgr2=0x7f0ae803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.905 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f0ae803d170 0x7f0ae803f680 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 msgr2=0x9d8fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.903+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x9d8fd0 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 shutdown_connections 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> v2:172.21.15.59:6800/3457013714 conn(0x8d2130 0x9eb360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f0ae803d170 0x7f0ae803f680 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 --2- 172.21.15.59:0/1917748748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x8c9fc0 0x9d8fd0 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 >> 172.21.15.59:0/1917748748 conn(0x7f6770 msgr2=0x8cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 shutdown_connections 2024-09-16T17:03:07.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.904+0000 7f0b09f31ec0 1 -- 172.21.15.59:0/1917748748 wait complete. 2024-09-16T17:03:07.907 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:07.907 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj4 /etc/passwd 2024-09-16T17:03:07.945 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.944+0000 7f4545a71ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.951 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.950+0000 7f4545a71ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.951 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.950+0000 7f4545a71ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:07.952 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.951+0000 7f4545a71ec0 1 Processor -- start 2024-09-16T17:03:07.952 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.951+0000 7f4545a71ec0 1 -- start start 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f4545a71ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xb64590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f4545a71ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x9b0520 con 0xa4c300 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f453db9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xb64590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f453db9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xb64590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54202/0 (socket says 172.21.15.59:54202) 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f453db9b640 1 -- 172.21.15.59:0/3175685997 learned_addr learned my addr 172.21.15.59:0/3175685997 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f453db9b640 1 -- 172.21.15.59:0/3175685997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x94ce10 con 0xa4c300 2024-09-16T17:03:07.954 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f453db9b640 1 --2- 172.21.15.59:0/3175685997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xb64590 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d724e8f216af17 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.955 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f4537fff640 1 -- 172.21.15.59:0/3175685997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f452802dc20 con 0xa4c300 2024-09-16T17:03:07.955 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f4537fff640 1 -- 172.21.15.59:0/3175685997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4528037370 con 0xa4c300 2024-09-16T17:03:07.955 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.953+0000 7f4537fff640 1 -- 172.21.15.59:0/3175685997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4528037610 con 0xa4c300 2024-09-16T17:03:07.955 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 -- 172.21.15.59:0/3175685997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 msgr2=0xb64590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.955 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/3175685997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xb64590 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 -- 172.21.15.59:0/3175685997 shutdown_connections 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/3175685997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xb64590 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 -- 172.21.15.59:0/3175685997 >> 172.21.15.59:0/3175685997 conn(0x970770 msgr2=0xa4e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 -- 172.21.15.59:0/3175685997 shutdown_connections 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.954+0000 7f4545a71ec0 1 -- 172.21.15.59:0/3175685997 wait complete. 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.955+0000 7f4545a71ec0 1 Processor -- start 2024-09-16T17:03:07.956 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.955+0000 7f4545a71ec0 1 -- start start 2024-09-16T17:03:07.958 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4545a71ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xadab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.958 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4545a71ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x9ae280 con 0xa4c300 2024-09-16T17:03:07.958 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f453db9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xadab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.958 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f453db9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xadab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54218/0 (socket says 172.21.15.59:54218) 2024-09-16T17:03:07.958 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f453db9b640 1 -- 172.21.15.59:0/1378215889 learned_addr learned my addr 172.21.15.59:0/1378215889 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f453db9b640 1 -- 172.21.15.59:0/1378215889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x93e920 con 0xa4c300 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f453db9b640 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xadab80 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4536ffd640 1 -- 172.21.15.59:0/1378215889 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f452803e040 con 0xa4c300 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4536ffd640 1 -- 172.21.15.59:0/1378215889 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f452802daf0 con 0xa4c300 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x93e380 con 0xa4c300 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4536ffd640 1 -- 172.21.15.59:0/1378215889 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4528037e20 con 0xa4c300 2024-09-16T17:03:07.959 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.957+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0xacb660 con 0xa4c300 2024-09-16T17:03:07.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.958+0000 7f4536ffd640 1 -- 172.21.15.59:0/1378215889 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4528041040 con 0xa4c300 2024-09-16T17:03:07.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.959+0000 7f4536ffd640 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f452403d1c0 0x7f452403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.959+0000 7f4536ffd640 1 -- 172.21.15.59:0/1378215889 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7f4528032040 con 0xa4c300 2024-09-16T17:03:07.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.959+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> v2:172.21.15.59:6811/1210870840 conn(0xadea60 0xac7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:07.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.959+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0xaca9f0 con 0xadea60 2024-09-16T17:03:07.960 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.959+0000 7f453d39a640 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f452403d1c0 0x7f452403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:07.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.960+0000 7f453d39a640 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f452403d1c0 0x7f452403f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.961 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.960+0000 7f453e39c640 1 --2- 172.21.15.59:0/1378215889 >> v2:172.21.15.59:6811/1210870840 conn(0xadea60 0xac7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:07.964 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.963+0000 7f453e39c640 1 --2- 172.21.15.59:0/1378215889 >> v2:172.21.15.59:6811/1210870840 conn(0xadea60 0xac7f90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f453e39c640 1 -- 172.21.15.59:0/1378215889 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f453000a430 con 0xadea60 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 >> v2:172.21.15.59:6811/1210870840 conn(0xadea60 msgr2=0xac7f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> v2:172.21.15.59:6811/1210870840 conn(0xadea60 0xac7f90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f452403d1c0 msgr2=0x7f452403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f452403d1c0 0x7f452403f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 msgr2=0xadab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xadab80 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 shutdown_connections 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> v2:172.21.15.59:6811/1210870840 conn(0xadea60 0xac7f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f452403d1c0 0x7f452403f6d0 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.977+0000 7f4545a71ec0 1 --2- 172.21.15.59:0/1378215889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa4c300 0xadab80 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:07.979 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.978+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 >> 172.21.15.59:0/1378215889 conn(0x970770 msgr2=0xb64590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:07.980 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.978+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 shutdown_connections 2024-09-16T17:03:07.980 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:07.978+0000 7f4545a71ec0 1 -- 172.21.15.59:0/1378215889 wait complete. 2024-09-16T17:03:07.981 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:07.981 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj5 /etc/passwd 2024-09-16T17:03:08.019 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.018+0000 7fa5ba8ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.025 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.024+0000 7fa5ba8ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.025 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.024+0000 7fa5ba8ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.026 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.025+0000 7fa5ba8ebec0 1 Processor -- start 2024-09-16T17:03:08.026 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.025+0000 7fa5ba8ebec0 1 -- start start 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.026+0000 7fa5ba8ebec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1fb4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.026+0000 7fa5ba8ebec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1e8b520 con 0x1fb53a0 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b2c3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1fb4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b2c3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1fb4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54234/0 (socket says 172.21.15.59:54234) 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b2c3f640 1 -- 172.21.15.59:0/4248184505 learned_addr learned my addr 172.21.15.59:0/4248184505 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b2c3f640 1 -- 172.21.15.59:0/4248184505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e27e10 con 0x1fb53a0 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b2c3f640 1 --2- 172.21.15.59:0/4248184505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1fb4a20 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f829382cd3afe6e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.028 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b143c640 1 -- 172.21.15.59:0/4248184505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c0061f0 con 0x1fb53a0 2024-09-16T17:03:08.029 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b143c640 1 -- 172.21.15.59:0/4248184505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa59c001980 con 0x1fb53a0 2024-09-16T17:03:08.029 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.027+0000 7fa5b143c640 1 -- 172.21.15.59:0/4248184505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c001af0 con 0x1fb53a0 2024-09-16T17:03:08.029 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/4248184505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 msgr2=0x1fb4a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.029 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/4248184505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1fb4a20 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.029 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/4248184505 shutdown_connections 2024-09-16T17:03:08.030 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/4248184505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1fb4a20 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.030 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/4248184505 >> 172.21.15.59:0/4248184505 conn(0x1e4b770 msgr2=0x1fb82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.030 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/4248184505 shutdown_connections 2024-09-16T17:03:08.030 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.028+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/4248184505 wait complete. 2024-09-16T17:03:08.030 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.029+0000 7fa5ba8ebec0 1 Processor -- start 2024-09-16T17:03:08.030 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.029+0000 7fa5ba8ebec0 1 -- start start 2024-09-16T17:03:08.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5ba8ebec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1f23060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5ba8ebec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1e89280 con 0x1fb53a0 2024-09-16T17:03:08.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5b2c3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1f23060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5b2c3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1f23060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54248/0 (socket says 172.21.15.59:54248) 2024-09-16T17:03:08.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5b2c3f640 1 -- 172.21.15.59:0/666563710 learned_addr learned my addr 172.21.15.59:0/666563710 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5b2c3f640 1 -- 172.21.15.59:0/666563710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e19920 con 0x1fb53a0 2024-09-16T17:03:08.033 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5b2c3f640 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1f23060 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.033 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5abfff640 1 -- 172.21.15.59:0/666563710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c011c10 con 0x1fb53a0 2024-09-16T17:03:08.033 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5abfff640 1 -- 172.21.15.59:0/666563710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa59c011d70 con 0x1fb53a0 2024-09-16T17:03:08.033 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5abfff640 1 -- 172.21.15.59:0/666563710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa59c012460 con 0x1fb53a0 2024-09-16T17:03:08.033 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e19380 con 0x1fb53a0 2024-09-16T17:03:08.033 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.031+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1fa3240 con 0x1fb53a0 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.032+0000 7fa5abfff640 1 -- 172.21.15.59:0/666563710 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa59c012610 con 0x1fb53a0 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.033+0000 7fa5abfff640 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa59803d1c0 0x7fa59803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.033+0000 7fa5abfff640 1 -- 172.21.15.59:0/666563710 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7fa59c04f970 con 0x1fb53a0 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.033+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> v2:172.21.15.104:6808/851587968 conn(0x1fbb840 0x1f23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.033+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x204da30 con 0x1fbb840 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.033+0000 7fa5b243e640 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa59803d1c0 0x7fa59803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.034 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.033+0000 7fa5b243e640 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa59803d1c0 0x7fa59803f6d0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.034+0000 7fa5b3440640 1 --2- 172.21.15.59:0/666563710 >> v2:172.21.15.104:6808/851587968 conn(0x1fbb840 0x1f23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:08.038 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.037+0000 7fa5b3440640 1 --2- 172.21.15.59:0/666563710 >> v2:172.21.15.104:6808/851587968 conn(0x1fbb840 0x1f23ab0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5b3440640 1 -- 172.21.15.59:0/666563710 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa5a400c430 con 0x1fbb840 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 >> v2:172.21.15.104:6808/851587968 conn(0x1fbb840 msgr2=0x1f23ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> v2:172.21.15.104:6808/851587968 conn(0x1fbb840 0x1f23ab0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa59803d1c0 msgr2=0x7fa59803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa59803d1c0 0x7fa59803f6d0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 msgr2=0x1f23060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1f23060 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 shutdown_connections 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> v2:172.21.15.104:6808/851587968 conn(0x1fbb840 0x1f23ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa59803d1c0 0x7fa59803f6d0 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 --2- 172.21.15.59:0/666563710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1fb53a0 0x1f23060 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 >> 172.21.15.59:0/666563710 conn(0x1e4b770 msgr2=0x1f2a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 shutdown_connections 2024-09-16T17:03:08.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.052+0000 7fa5ba8ebec0 1 -- 172.21.15.59:0/666563710 wait complete. 2024-09-16T17:03:08.055 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:08.056 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj6 /etc/passwd 2024-09-16T17:03:08.093 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.092+0000 7f50d5f76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.098 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.098+0000 7f50d5f76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.098 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.098+0000 7f50d5f76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.099 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.099+0000 7f50d5f76ec0 1 Processor -- start 2024-09-16T17:03:08.099 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.099+0000 7f50d5f76ec0 1 -- start start 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.100+0000 7f50d5f76ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x119f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.100+0000 7f50d5f76ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1105520 con 0x1233a60 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.100+0000 7f50ce99b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x119f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.100+0000 7f50ce99b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x119f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54268/0 (socket says 172.21.15.59:54268) 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.100+0000 7f50ce99b640 1 -- 172.21.15.59:0/3971125859 learned_addr learned my addr 172.21.15.59:0/3971125859 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.101+0000 7f50ce99b640 1 -- 172.21.15.59:0/3971125859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x10a1e10 con 0x1233a60 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.101+0000 7f50ce99b640 1 --2- 172.21.15.59:0/3971125859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x119f320 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7700af55c372d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.101+0000 7f50cd198640 1 -- 172.21.15.59:0/3971125859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50b800b580 con 0x1233a60 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.101+0000 7f50cd198640 1 -- 172.21.15.59:0/3971125859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f50b800b6e0 con 0x1233a60 2024-09-16T17:03:08.102 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.101+0000 7f50cd198640 1 -- 172.21.15.59:0/3971125859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50b800b980 con 0x1233a60 2024-09-16T17:03:08.103 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/3971125859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 msgr2=0x119f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.103 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/3971125859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x119f320 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.103 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/3971125859 shutdown_connections 2024-09-16T17:03:08.104 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/3971125859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x119f320 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.104 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/3971125859 >> 172.21.15.59:0/3971125859 conn(0x10c5770 msgr2=0x1231380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.104 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/3971125859 shutdown_connections 2024-09-16T17:03:08.104 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.102+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/3971125859 wait complete. 2024-09-16T17:03:08.104 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.103+0000 7f50d5f76ec0 1 Processor -- start 2024-09-16T17:03:08.104 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.103+0000 7f50d5f76ec0 1 -- start start 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.104+0000 7f50d5f76ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x121e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.104+0000 7f50d5f76ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1103280 con 0x1233a60 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.104+0000 7f50ce99b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x121e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.104+0000 7f50ce99b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x121e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54280/0 (socket says 172.21.15.59:54280) 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.104+0000 7f50ce99b640 1 -- 172.21.15.59:0/1699049624 learned_addr learned my addr 172.21.15.59:0/1699049624 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50ce99b640 1 -- 172.21.15.59:0/1699049624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1093920 con 0x1233a60 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50ce99b640 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x121e330 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50c7fff640 1 -- 172.21.15.59:0/1699049624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50b80129c0 con 0x1233a60 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50c7fff640 1 -- 172.21.15.59:0/1699049624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f50b8005040 con 0x1233a60 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1093380 con 0x1233a60 2024-09-16T17:03:08.106 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50c7fff640 1 -- 172.21.15.59:0/1699049624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50b8012c50 con 0x1233a60 2024-09-16T17:03:08.107 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.105+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x119e990 con 0x1233a60 2024-09-16T17:03:08.107 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.106+0000 7f50c7fff640 1 -- 172.21.15.59:0/1699049624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f50b800d040 con 0x1233a60 2024-09-16T17:03:08.107 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.106+0000 7f50c7fff640 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f50b403d1c0 0x7f50b403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.106+0000 7f50c7fff640 1 -- 172.21.15.59:0/1699049624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7f50b800a040 con 0x1233a60 2024-09-16T17:03:08.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.106+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> v2:172.21.15.59:6800/3457013714 conn(0x1236890 0x16ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.107+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1221330 con 0x1236890 2024-09-16T17:03:08.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.107+0000 7f50ce19a640 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f50b403d1c0 0x7f50b403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.107+0000 7f50ce19a640 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f50b403d1c0 0x7f50b403f6d0 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.107+0000 7f50cf19c640 1 --2- 172.21.15.59:0/1699049624 >> v2:172.21.15.59:6800/3457013714 conn(0x1236890 0x16ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:08.112 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.111+0000 7f50cf19c640 1 --2- 172.21.15.59:0/1699049624 >> v2:172.21.15.59:6800/3457013714 conn(0x1236890 0x16ccab0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50cf19c640 1 -- 172.21.15.59:0/1699049624 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f50c000a430 con 0x1236890 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 >> v2:172.21.15.59:6800/3457013714 conn(0x1236890 msgr2=0x16ccab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> v2:172.21.15.59:6800/3457013714 conn(0x1236890 0x16ccab0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f50b403d1c0 msgr2=0x7f50b403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f50b403d1c0 0x7f50b403f6d0 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 msgr2=0x121e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.127 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x121e330 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 shutdown_connections 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> v2:172.21.15.59:6800/3457013714 conn(0x1236890 0x16ccab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f50b403d1c0 0x7f50b403f6d0 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 --2- 172.21.15.59:0/1699049624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1233a60 0x121e330 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 >> 172.21.15.59:0/1699049624 conn(0x10c5770 msgr2=0x11a41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 shutdown_connections 2024-09-16T17:03:08.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.126+0000 7f50d5f76ec0 1 -- 172.21.15.59:0/1699049624 wait complete. 2024-09-16T17:03:08.130 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:08.130 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj7 /etc/passwd 2024-09-16T17:03:08.167 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.166+0000 7f650e343ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.173 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.172+0000 7f650e343ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.173 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.172+0000 7f650e343ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.173+0000 7f650e343ec0 1 Processor -- start 2024-09-16T17:03:08.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.173+0000 7f650e343ec0 1 -- start start 2024-09-16T17:03:08.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650e343ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x1420590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650e343ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x126c520 con 0x1308300 2024-09-16T17:03:08.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650679b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x1420590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650679b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x1420590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54312/0 (socket says 172.21.15.59:54312) 2024-09-16T17:03:08.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650679b640 1 -- 172.21.15.59:0/3716067837 learned_addr learned my addr 172.21.15.59:0/3716067837 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650679b640 1 -- 172.21.15.59:0/3716067837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1208e10 con 0x1308300 2024-09-16T17:03:08.177 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f650679b640 1 --2- 172.21.15.59:0/3716067837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x1420590 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f85d4155837132c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.177 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f6504f98640 1 -- 172.21.15.59:0/3716067837 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64f0032040 con 0x1308300 2024-09-16T17:03:08.177 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f6504f98640 1 -- 172.21.15.59:0/3716067837 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f64f0033040 con 0x1308300 2024-09-16T17:03:08.177 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.175+0000 7f6504f98640 1 -- 172.21.15.59:0/3716067837 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64f002ddb0 con 0x1308300 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 -- 172.21.15.59:0/3716067837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 msgr2=0x1420590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 --2- 172.21.15.59:0/3716067837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x1420590 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 -- 172.21.15.59:0/3716067837 shutdown_connections 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 --2- 172.21.15.59:0/3716067837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x1420590 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 -- 172.21.15.59:0/3716067837 >> 172.21.15.59:0/3716067837 conn(0x122c770 msgr2=0x130a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 -- 172.21.15.59:0/3716067837 shutdown_connections 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.176+0000 7f650e343ec0 1 -- 172.21.15.59:0/3716067837 wait complete. 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.177+0000 7f650e343ec0 1 Processor -- start 2024-09-16T17:03:08.178 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.177+0000 7f650e343ec0 1 -- start start 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.178+0000 7f650e343ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x142f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.178+0000 7f650e343ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x126a280 con 0x1308300 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650679b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x142f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650679b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x142f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54316/0 (socket says 172.21.15.59:54316) 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650679b640 1 -- 172.21.15.59:0/2545412513 learned_addr learned my addr 172.21.15.59:0/2545412513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650679b640 1 -- 172.21.15.59:0/2545412513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11fa920 con 0x1308300 2024-09-16T17:03:08.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650679b640 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x142f7d0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.181 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f64feffd640 1 -- 172.21.15.59:0/2545412513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64f0032040 con 0x1308300 2024-09-16T17:03:08.181 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f64feffd640 1 -- 172.21.15.59:0/2545412513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f64f00386d0 con 0x1308300 2024-09-16T17:03:08.181 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f64feffd640 1 -- 172.21.15.59:0/2545412513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64f0038970 con 0x1308300 2024-09-16T17:03:08.181 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x11fa380 con 0x1308300 2024-09-16T17:03:08.181 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.179+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x13842c0 con 0x1308300 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.180+0000 7f64feffd640 1 -- 172.21.15.59:0/2545412513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f64f0003040 con 0x1308300 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.181+0000 7f64feffd640 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f64ec03d170 0x7f64ec03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.181+0000 7f64feffd640 1 -- 172.21.15.59:0/2545412513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7f64f00732e0 con 0x1308300 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.181+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> v2:172.21.15.59:6811/1210870840 conn(0x139aa60 0x1396f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.181+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1386c70 con 0x139aa60 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.181+0000 7f6505f9a640 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f64ec03d170 0x7f64ec03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.182 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.181+0000 7f6505f9a640 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f64ec03d170 0x7f64ec03f680 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.183 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.182+0000 7f6506f9c640 1 --2- 172.21.15.59:0/2545412513 >> v2:172.21.15.59:6811/1210870840 conn(0x139aa60 0x1396f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:08.186 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.185+0000 7f6506f9c640 1 --2- 172.21.15.59:0/2545412513 >> v2:172.21.15.59:6811/1210870840 conn(0x139aa60 0x1396f00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f6506f9c640 1 -- 172.21.15.59:0/2545412513 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64f800c430 con 0x139aa60 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 >> v2:172.21.15.59:6811/1210870840 conn(0x139aa60 msgr2=0x1396f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> v2:172.21.15.59:6811/1210870840 conn(0x139aa60 0x1396f00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f64ec03d170 msgr2=0x7f64ec03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f64ec03d170 0x7f64ec03f680 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 msgr2=0x142f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x142f7d0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 shutdown_connections 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> v2:172.21.15.59:6811/1210870840 conn(0x139aa60 0x1396f00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f64ec03d170 0x7f64ec03f680 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 --2- 172.21.15.59:0/2545412513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1308300 0x142f7d0 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 >> 172.21.15.59:0/2545412513 conn(0x122c770 msgr2=0x1420590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 shutdown_connections 2024-09-16T17:03:08.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.202+0000 7f650e343ec0 1 -- 172.21.15.59:0/2545412513 wait complete. 2024-09-16T17:03:08.206 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:08.206 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj8 /etc/passwd 2024-09-16T17:03:08.243 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.243+0000 7fe6d403bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.249 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.248+0000 7fe6d403bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.249 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.249+0000 7fe6d403bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.250 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.249+0000 7fe6d403bec0 1 Processor -- start 2024-09-16T17:03:08.250 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.250+0000 7fe6d403bec0 1 -- start start 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.251+0000 7fe6d403bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1aa8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.251+0000 7fe6d403bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1a15520 con 0x1ab1300 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.251+0000 7fe6c77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1aa8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.251+0000 7fe6c77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1aa8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54334/0 (socket says 172.21.15.59:54334) 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.251+0000 7fe6c77fe640 1 -- 172.21.15.59:0/3204229201 learned_addr learned my addr 172.21.15.59:0/3204229201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.251+0000 7fe6c77fe640 1 -- 172.21.15.59:0/3204229201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19b1e10 con 0x1ab1300 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6c77fe640 1 --2- 172.21.15.59:0/3204229201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1aa8440 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8353afa2c9133eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6c5ffb640 1 -- 172.21.15.59:0/3204229201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe6b80061f0 con 0x1ab1300 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6c5ffb640 1 -- 172.21.15.59:0/3204229201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe6b8001980 con 0x1ab1300 2024-09-16T17:03:08.253 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6c5ffb640 1 -- 172.21.15.59:0/3204229201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe6b8001af0 con 0x1ab1300 2024-09-16T17:03:08.254 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6d403bec0 1 -- 172.21.15.59:0/3204229201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 msgr2=0x1aa8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.254 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/3204229201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1aa8440 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.254 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6d403bec0 1 -- 172.21.15.59:0/3204229201 shutdown_connections 2024-09-16T17:03:08.254 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/3204229201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1aa8440 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.254 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.252+0000 7fe6d403bec0 1 -- 172.21.15.59:0/3204229201 >> 172.21.15.59:0/3204229201 conn(0x19d5770 msgr2=0x1ab36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.255 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.253+0000 7fe6d403bec0 1 -- 172.21.15.59:0/3204229201 shutdown_connections 2024-09-16T17:03:08.255 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.253+0000 7fe6d403bec0 1 -- 172.21.15.59:0/3204229201 wait complete. 2024-09-16T17:03:08.255 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.253+0000 7fe6d403bec0 1 Processor -- start 2024-09-16T17:03:08.255 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.254+0000 7fe6d403bec0 1 -- start start 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.255+0000 7fe6d403bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1b2f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.255+0000 7fe6d403bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1a13280 con 0x1ab1300 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.255+0000 7fe6c77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1b2f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.255+0000 7fe6c77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1b2f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54336/0 (socket says 172.21.15.59:54336) 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.255+0000 7fe6c77fe640 1 -- 172.21.15.59:0/2414845189 learned_addr learned my addr 172.21.15.59:0/2414845189 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.255+0000 7fe6c77fe640 1 -- 172.21.15.59:0/2414845189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19a3920 con 0x1ab1300 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.256+0000 7fe6c77fe640 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1b2f400 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.256+0000 7fe6c4ff9640 1 -- 172.21.15.59:0/2414845189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe6b8011c10 con 0x1ab1300 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.256+0000 7fe6c4ff9640 1 -- 172.21.15.59:0/2414845189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe6b8011d70 con 0x1ab1300 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.256+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x19a3380 con 0x1ab1300 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.256+0000 7fe6c4ff9640 1 -- 172.21.15.59:0/2414845189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe6b8012460 con 0x1ab1300 2024-09-16T17:03:08.257 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.256+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1b33300 con 0x1ab1300 2024-09-16T17:03:08.258 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.257+0000 7fe6c4ff9640 1 -- 172.21.15.59:0/2414845189 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe6b8012610 con 0x1ab1300 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.257+0000 7fe6c4ff9640 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe6b403d1c0 0x7fe6b403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.257+0000 7fe6c4ff9640 1 -- 172.21.15.59:0/2414845189 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7fe6b804f980 con 0x1ab1300 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.257+0000 7fe6c6ffd640 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe6b403d1c0 0x7fe6b403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.258+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> v2:172.21.15.104:6803/2992308739 conn(0x1ab1e20 0x1bd8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.258+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 --> v2:172.21.15.104:6803/2992308739 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1b32e70 con 0x1ab1e20 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.258+0000 7fe6c6ffd640 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe6b403d1c0 0x7fe6b403f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.259 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.258+0000 7fe6cc99c640 1 --2- 172.21.15.59:0/2414845189 >> v2:172.21.15.104:6803/2992308739 conn(0x1ab1e20 0x1bd8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:08.263 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.262+0000 7fe6cc99c640 1 --2- 172.21.15.59:0/2414845189 >> v2:172.21.15.104:6803/2992308739 conn(0x1ab1e20 0x1bd8820 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6cc99c640 1 -- 172.21.15.59:0/2414845189 <== osd.2 v2:172.21.15.104:6803/2992308739 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe6c000c430 con 0x1ab1e20 2024-09-16T17:03:08.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 >> v2:172.21.15.104:6803/2992308739 conn(0x1ab1e20 msgr2=0x1bd8820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> v2:172.21.15.104:6803/2992308739 conn(0x1ab1e20 0x1bd8820 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe6b403d1c0 msgr2=0x7fe6b403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe6b403d1c0 0x7fe6b403f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 msgr2=0x1b2f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1b2f400 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 shutdown_connections 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> v2:172.21.15.104:6803/2992308739 conn(0x1ab1e20 0x1bd8820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe6b403d1c0 0x7fe6b403f6d0 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 --2- 172.21.15.59:0/2414845189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1ab1300 0x1b2f400 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 >> 172.21.15.59:0/2414845189 conn(0x19d5770 msgr2=0x1ab36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 shutdown_connections 2024-09-16T17:03:08.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.277+0000 7fe6d403bec0 1 -- 172.21.15.59:0/2414845189 wait complete. 2024-09-16T17:03:08.280 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:08.280 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj9 /etc/passwd 2024-09-16T17:03:08.317 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.317+0000 7f27de832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.323 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.323+0000 7f27de832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.324 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.323+0000 7f27de832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.324 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.324+0000 7f27de832ec0 1 Processor -- start 2024-09-16T17:03:08.324 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.324+0000 7f27de832ec0 1 -- start start 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.325+0000 7f27de832ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x85c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.325+0000 7f27de832ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x732520 con 0x85dd10 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.325+0000 7f27d699b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x85c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.325+0000 7f27d699b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x85c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54354/0 (socket says 172.21.15.59:54354) 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.325+0000 7f27d699b640 1 -- 172.21.15.59:0/3059717321 learned_addr learned my addr 172.21.15.59:0/3059717321 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.326+0000 7f27d699b640 1 -- 172.21.15.59:0/3059717321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6cee10 con 0x85dd10 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.326+0000 7f27d699b640 1 --2- 172.21.15.59:0/3059717321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x85c8b0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad1d934e2d0ae8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.326+0000 7f27d5198640 1 -- 172.21.15.59:0/3059717321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27c000b580 con 0x85dd10 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.326+0000 7f27d5198640 1 -- 172.21.15.59:0/3059717321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27c000b6e0 con 0x85dd10 2024-09-16T17:03:08.327 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.326+0000 7f27d5198640 1 -- 172.21.15.59:0/3059717321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27c000b980 con 0x85dd10 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 -- 172.21.15.59:0/3059717321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 msgr2=0x85c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3059717321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x85c8b0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 -- 172.21.15.59:0/3059717321 shutdown_connections 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3059717321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x85c8b0 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 -- 172.21.15.59:0/3059717321 >> 172.21.15.59:0/3059717321 conn(0x6f2770 msgr2=0x7cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 -- 172.21.15.59:0/3059717321 shutdown_connections 2024-09-16T17:03:08.328 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.327+0000 7f27de832ec0 1 -- 172.21.15.59:0/3059717321 wait complete. 2024-09-16T17:03:08.329 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.328+0000 7f27de832ec0 1 Processor -- start 2024-09-16T17:03:08.329 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.328+0000 7f27de832ec0 1 -- start start 2024-09-16T17:03:08.330 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.329+0000 7f27de832ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x8e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.330 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.329+0000 7f27de832ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x730280 con 0x85dd10 2024-09-16T17:03:08.330 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.329+0000 7f27d699b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x8e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.330 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.329+0000 7f27d699b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x8e7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54362/0 (socket says 172.21.15.59:54362) 2024-09-16T17:03:08.331 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.329+0000 7f27d699b640 1 -- 172.21.15.59:0/3969130379 learned_addr learned my addr 172.21.15.59:0/3969130379 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.331 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27d699b640 1 -- 172.21.15.59:0/3969130379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6c0920 con 0x85dd10 2024-09-16T17:03:08.331 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27d699b640 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x8e7200 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.331 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27cffff640 1 -- 172.21.15.59:0/3969130379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27c00129e0 con 0x85dd10 2024-09-16T17:03:08.332 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27cffff640 1 -- 172.21.15.59:0/3969130379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27c0005040 con 0x85dd10 2024-09-16T17:03:08.332 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x6c0380 con 0x85dd10 2024-09-16T17:03:08.332 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27cffff640 1 -- 172.21.15.59:0/3969130379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27c0012c70 con 0x85dd10 2024-09-16T17:03:08.332 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.330+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x8ed0c0 con 0x85dd10 2024-09-16T17:03:08.332 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.331+0000 7f27cffff640 1 -- 172.21.15.59:0/3969130379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f27c000d040 con 0x85dd10 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.331+0000 7f27cffff640 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f27bc03d1c0 0x7f27bc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.331+0000 7f27cffff640 1 -- 172.21.15.59:0/3969130379 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7f27c000a040 con 0x85dd10 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.332+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> v2:172.21.15.59:6800/3457013714 conn(0x85e830 0x859680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.332+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x85d210 con 0x85e830 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.332+0000 7f27d619a640 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f27bc03d1c0 0x7f27bc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.332+0000 7f27d619a640 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f27bc03d1c0 0x7f27bc03f6d0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.333 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.332+0000 7f27d719c640 1 --2- 172.21.15.59:0/3969130379 >> v2:172.21.15.59:6800/3457013714 conn(0x85e830 0x859680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:08.336 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.335+0000 7f27d719c640 1 --2- 172.21.15.59:0/3969130379 >> v2:172.21.15.59:6800/3457013714 conn(0x85e830 0x859680 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.349+0000 7f27d719c640 1 -- 172.21.15.59:0/3969130379 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v698'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f27c800a430 con 0x85e830 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 >> v2:172.21.15.59:6800/3457013714 conn(0x85e830 msgr2=0x859680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> v2:172.21.15.59:6800/3457013714 conn(0x85e830 0x859680 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f27bc03d1c0 msgr2=0x7f27bc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f27bc03d1c0 0x7f27bc03f6d0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 msgr2=0x8e7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x8e7200 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 shutdown_connections 2024-09-16T17:03:08.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> v2:172.21.15.59:6800/3457013714 conn(0x85e830 0x859680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f27bc03d1c0 0x7f27bc03f6d0 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 --2- 172.21.15.59:0/3969130379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x85dd10 0x8e7200 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 >> 172.21.15.59:0/3969130379 conn(0x6f2770 msgr2=0x7cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 shutdown_connections 2024-09-16T17:03:08.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.350+0000 7f27de832ec0 1 -- 172.21.15.59:0/3969130379 wait complete. 2024-09-16T17:03:08.353 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:08.353 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put obj10 /etc/passwd 2024-09-16T17:03:08.390 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.390+0000 7fb843a2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.396 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.396+0000 7fb843a2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.396 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.396+0000 7fb843a2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:08.397 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.397+0000 7fb843a2bec0 1 Processor -- start 2024-09-16T17:03:08.397 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.397+0000 7fb843a2bec0 1 -- start start 2024-09-16T17:03:08.399 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.398+0000 7fb843a2bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xa25d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.399 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.398+0000 7fb843a2bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x9a4520 con 0xa37fc0 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.398+0000 7fb836ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xa25d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.398+0000 7fb836ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xa25d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54376/0 (socket says 172.21.15.59:54376) 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.398+0000 7fb836ffd640 1 -- 172.21.15.59:0/954898868 learned_addr learned my addr 172.21.15.59:0/954898868 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb836ffd640 1 -- 172.21.15.59:0/954898868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x940e10 con 0xa37fc0 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb836ffd640 1 --2- 172.21.15.59:0/954898868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xa25d80 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fbb8534c1657c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb8357fa640 1 -- 172.21.15.59:0/954898868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb830032040 con 0xa37fc0 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb8357fa640 1 -- 172.21.15.59:0/954898868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb830033040 con 0xa37fc0 2024-09-16T17:03:08.400 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb8357fa640 1 -- 172.21.15.59:0/954898868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb830034480 con 0xa37fc0 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb843a2bec0 1 -- 172.21.15.59:0/954898868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 msgr2=0xa25d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/954898868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xa25d80 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb843a2bec0 1 -- 172.21.15.59:0/954898868 shutdown_connections 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/954898868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xa25d80 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.399+0000 7fb843a2bec0 1 -- 172.21.15.59:0/954898868 >> 172.21.15.59:0/954898868 conn(0x964770 msgr2=0xa3bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.400+0000 7fb843a2bec0 1 -- 172.21.15.59:0/954898868 shutdown_connections 2024-09-16T17:03:08.401 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.400+0000 7fb843a2bec0 1 -- 172.21.15.59:0/954898868 wait complete. 2024-09-16T17:03:08.402 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.400+0000 7fb843a2bec0 1 Processor -- start 2024-09-16T17:03:08.402 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.401+0000 7fb843a2bec0 1 -- start start 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.402+0000 7fb843a2bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xb46e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.402+0000 7fb843a2bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x9a2280 con 0xa37fc0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.402+0000 7fb836ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xb46e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.402+0000 7fb836ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xb46e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54388/0 (socket says 172.21.15.59:54388) 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.402+0000 7fb836ffd640 1 -- 172.21.15.59:0/660569978 learned_addr learned my addr 172.21.15.59:0/660569978 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.402+0000 7fb836ffd640 1 -- 172.21.15.59:0/660569978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x932920 con 0xa37fc0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.403+0000 7fb836ffd640 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xb46e00 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.403+0000 7fb82ffff640 1 -- 172.21.15.59:0/660569978 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb830032040 con 0xa37fc0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.403+0000 7fb82ffff640 1 -- 172.21.15.59:0/660569978 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb830037b20 con 0xa37fc0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.403+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x932380 con 0xa37fc0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.403+0000 7fb82ffff640 1 -- 172.21.15.59:0/660569978 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb830037dc0 con 0xa37fc0 2024-09-16T17:03:08.404 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.403+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb4ad50 con 0xa37fc0 2024-09-16T17:03:08.405 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.404+0000 7fb82ffff640 1 -- 172.21.15.59:0/660569978 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb830003040 con 0xa37fc0 2024-09-16T17:03:08.405 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.404+0000 7fb82ffff640 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb81803d170 0x7fb81803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.405 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.404+0000 7fb82ffff640 1 -- 172.21.15.59:0/660569978 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(698..698 src has 403..698) ==== 3819+0+0 (crc 0 0 0) 0x7fb830073450 con 0xa37fc0 2024-09-16T17:03:08.405 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.404+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> v2:172.21.15.59:6800/3457013714 conn(0xa40130 0xb591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:08.406 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.404+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0xb4a800 con 0xa40130 2024-09-16T17:03:08.406 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.404+0000 7fb8367fc640 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb81803d170 0x7fb81803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:08.406 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.405+0000 7fb8367fc640 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb81803d170 0x7fb81803f680 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.406 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.405+0000 7fb8377fe640 1 --2- 172.21.15.59:0/660569978 >> v2:172.21.15.59:6800/3457013714 conn(0xa40130 0xb591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:08.409 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.409+0000 7fb8377fe640 1 --2- 172.21.15.59:0/660569978 >> v2:172.21.15.59:6800/3457013714 conn(0xa40130 0xb591f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:08.425 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.423+0000 7fb8377fe640 1 -- 172.21.15.59:0/660569978 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb82800c430 con 0xa40130 2024-09-16T17:03:08.425 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 >> v2:172.21.15.59:6800/3457013714 conn(0xa40130 msgr2=0xb591f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.425 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> v2:172.21.15.59:6800/3457013714 conn(0xa40130 0xb591f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.425 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb81803d170 msgr2=0x7fb81803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.425 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb81803d170 0x7fb81803f680 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.425 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 msgr2=0xb46e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xb46e00 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 shutdown_connections 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> v2:172.21.15.59:6800/3457013714 conn(0xa40130 0xb591f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb81803d170 0x7fb81803f680 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 --2- 172.21.15.59:0/660569978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xa37fc0 0xb46e00 unknown :-1 s=CLOSED pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 >> 172.21.15.59:0/660569978 conn(0x964770 msgr2=0xa3bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 shutdown_connections 2024-09-16T17:03:08.426 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:08.424+0000 7fb843a2bec0 1 -- 172.21.15.59:0/660569978 wait complete. 2024-09-16T17:03:08.427 INFO:tasks.workunit.client.0.smithi059.stderr:+ sleep 30 2024-09-16T17:03:38.429 INFO:tasks.workunit.client.0.smithi059.stderr:+ pid=95954 2024-09-16T17:03:38.430 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_objects 100 2024-09-16T17:03:38.430 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put onemore /etc/passwd 2024-09-16T17:03:38.475 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.474+0000 7f69e191eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:38.481 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.481+0000 7f69e191eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:38.481 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.481+0000 7f69e191eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:38.482 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.482+0000 7f69e191eec0 1 Processor -- start 2024-09-16T17:03:38.482 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.482+0000 7f69e191eec0 1 -- start start 2024-09-16T17:03:38.484 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.483+0000 7f69e191eec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xe769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.485 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.483+0000 7f69e191eec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xdd7520 con 0xf059b0 2024-09-16T17:03:38.485 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.483+0000 7f69d9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xe769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:38.485 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xe769b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38638/0 (socket says 172.21.15.59:38638) 2024-09-16T17:03:38.485 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d9d9b640 1 -- 172.21.15.59:0/1697219607 learned_addr learned my addr 172.21.15.59:0/1697219607 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:38.485 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d9d9b640 1 -- 172.21.15.59:0/1697219607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd73e10 con 0xf059b0 2024-09-16T17:03:38.486 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d9d9b640 1 --2- 172.21.15.59:0/1697219607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xe769b0 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d11d26185d12157 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.486 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d37fe640 1 -- 172.21.15.59:0/1697219607 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69c400b580 con 0xf059b0 2024-09-16T17:03:38.486 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d37fe640 1 -- 172.21.15.59:0/1697219607 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f69c400b6e0 con 0xf059b0 2024-09-16T17:03:38.486 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.484+0000 7f69d37fe640 1 -- 172.21.15.59:0/1697219607 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69c400b980 con 0xf059b0 2024-09-16T17:03:38.487 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 -- 172.21.15.59:0/1697219607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 msgr2=0xe769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:38.487 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 --2- 172.21.15.59:0/1697219607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xe769b0 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:38.487 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 -- 172.21.15.59:0/1697219607 shutdown_connections 2024-09-16T17:03:38.487 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 --2- 172.21.15.59:0/1697219607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xe769b0 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:38.487 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 -- 172.21.15.59:0/1697219607 >> 172.21.15.59:0/1697219607 conn(0xd97770 msgr2=0xe6ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:38.487 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 -- 172.21.15.59:0/1697219607 shutdown_connections 2024-09-16T17:03:38.488 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.486+0000 7f69e191eec0 1 -- 172.21.15.59:0/1697219607 wait complete. 2024-09-16T17:03:38.488 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.487+0000 7f69e191eec0 1 Processor -- start 2024-09-16T17:03:38.488 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.487+0000 7f69e191eec0 1 -- start start 2024-09-16T17:03:38.490 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.489+0000 7f69e191eec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xef1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.490 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.489+0000 7f69e191eec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xdd5280 con 0xf059b0 2024-09-16T17:03:38.490 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.489+0000 7f69d9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xef1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:38.490 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.489+0000 7f69d9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xef1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38644/0 (socket says 172.21.15.59:38644) 2024-09-16T17:03:38.490 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.489+0000 7f69d9d9b640 1 -- 172.21.15.59:0/3685396991 learned_addr learned my addr 172.21.15.59:0/3685396991 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:38.491 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69d9d9b640 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd65920 con 0xf059b0 2024-09-16T17:03:38.492 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69d9d9b640 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xef1e70 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.492 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69c4012a40 con 0xf059b0 2024-09-16T17:03:38.492 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f69c4005040 con 0xf059b0 2024-09-16T17:03:38.492 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f69c4012cd0 con 0xf059b0 2024-09-16T17:03:38.492 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd65380 con 0xf059b0 2024-09-16T17:03:38.492 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.490+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0xef2e00 con 0xf059b0 2024-09-16T17:03:38.493 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.492+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f69c400d040 con 0xf059b0 2024-09-16T17:03:38.493 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.492+0000 7f69d27fc640 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f69c003d1c0 0x7f69c003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.493 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.492+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(700..700 src has 403..700) ==== 3819+0+0 (crc 0 0 0) 0x7f69c400a040 con 0xf059b0 2024-09-16T17:03:38.493 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.492+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7f69c00434b0 con 0xf059b0 2024-09-16T17:03:38.494 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.493+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> v2:172.21.15.104:6803/2992308739 conn(0xf064d0 0xf9acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.494 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.493+0000 7f69d959a640 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f69c003d1c0 0x7f69c003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:38.494 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.493+0000 7f69d959a640 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f69c003d1c0 0x7f69c003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.494 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.494+0000 7f69da59c640 1 --2- 172.21.15.59:0/3685396991 >> v2:172.21.15.104:6803/2992308739 conn(0xf064d0 0xf9acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:38.498 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.497+0000 7f69da59c640 1 --2- 172.21.15.59:0/3685396991 >> v2:172.21.15.104:6803/2992308739 conn(0xf064d0 0xf9acf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.540 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.530+0000 7fb4c245c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:38.542 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.541+0000 7fb4c245c640 1 Processor -- start 2024-09-16T17:03:38.542 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.541+0000 7fb4c245c640 1 -- start start 2024-09-16T17:03:38.544 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.542+0000 7fb4c245c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4bc06e6e0 0x7fb4bc06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.544 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.542+0000 7fb4c245c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4bc06dd50 con 0x7fb4bc136070 2024-09-16T17:03:38.544 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.542+0000 7fb4c245c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb4bc06e290 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.544 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bbfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4bc06e6e0 0x7fb4bc06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:38.544 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bbfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4bc06e6e0 0x7fb4bc06eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38660/0 (socket says 172.21.15.59:38660) 2024-09-16T17:03:38.544 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bbfff640 1 -- 172.21.15.59:0/1778239245 learned_addr learned my addr 172.21.15.59:0/1778239245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bb7fe640 1 --1- 172.21.15.59:0/1778239245 >> v1:172.21.15.59:6789/0 conn(0x7fb4bc136070 0x7fb4bc136480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39588/0 (socket says 172.21.15.59:39588) 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bbfff640 1 -- 172.21.15.59:0/1778239245 >> v1:172.21.15.59:6789/0 conn(0x7fb4bc136070 legacy=0x7fb4bc136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bbfff640 1 -- 172.21.15.59:0/1778239245 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc06f590 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4bbfff640 1 --2- 172.21.15.59:0/1778239245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc06eaf0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd7f72f23eb227f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4baffd640 1 -- 172.21.15.59:0/1778239245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4ac009e40 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4baffd640 1 -- 172.21.15.59:0/1778239245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb4ac00e230 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.545 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.543+0000 7fb4baffd640 1 -- 172.21.15.59:0/1778239245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4ac00e4d0 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 -- 172.21.15.59:0/1778239245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 msgr2=0x7fb4bc06eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 --2- 172.21.15.59:0/1778239245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc06eaf0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 -- 172.21.15.59:0/1778239245 shutdown_connections 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 --2- 172.21.15.59:0/1778239245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc06eaf0 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 -- 172.21.15.59:0/1778239245 >> 172.21.15.59:0/1778239245 conn(0x7fb4bc0a31b0 msgr2=0x7fb4bc0a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 -- 172.21.15.59:0/1778239245 shutdown_connections 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.544+0000 7fb4c245c640 1 -- 172.21.15.59:0/1778239245 wait complete. 2024-09-16T17:03:38.546 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.545+0000 7fb4c245c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:38.547 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.546+0000 7fb4c245c640 1 Processor -- start 2024-09-16T17:03:38.547 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.547+0000 7fb4c245c640 1 -- start start 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.548+0000 7fb4c245c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc122200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.548+0000 7fb4c245c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1218b0 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.548+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc122200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.548+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc122200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38676/0 (socket says 172.21.15.59:38676) 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.548+0000 7fb4bbfff640 1 -- 172.21.15.59:0/219095750 learned_addr learned my addr 172.21.15.59:0/219095750 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4bbfff640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc121e40 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4bbfff640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc122200 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4ac00ee10 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb4ac015420 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.550 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4bc124d80 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.551 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4ac0156c0 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.551 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.549+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4bc1240c0 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.551 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.550+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb4ac015870 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.552 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.550+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4bc070290 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.552 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.550+0000 7fb4b8ff9640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb4a803e960 0x7fb4a8040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:38.552 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.550+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(700..700 src has 403..700) ==== 3819+0+0 (crc 0 0 0) 0x7fb4ac051200 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.552 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.550+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7fb4a8044bf0 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.552 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.551+0000 7fb4bb7fe640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb4a803e960 0x7fb4a8040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:38.552 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.551+0000 7fb4bb7fe640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb4a803e960 0x7fb4a8040e70 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:38.556 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.555+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb4ac014c60 con 0x7fb4bc06e6e0 2024-09-16T17:03:38.743 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:38.742+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "100"} v 0) -- 0x7fb4bc06a450 con 0x7fb4bc06e6e0 2024-09-16T17:03:39.012 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:39.011+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v701) ==== 225+0+0 (crc 0 0 0) 0x7fb4ac012b80 con 0x7fb4bc06e6e0 2024-09-16T17:03:39.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:39.014+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 6 ==== osd_map(701..701 src has 403..701) ==== 628+0+0 (crc 0 0 0) 0x7f69c40077b0 con 0xf059b0 2024-09-16T17:03:39.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:39.014+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(701..701 src has 403..701) ==== 628+0+0 (crc 0 0 0) 0x7fb4ac012d40 con 0x7fb4bc06e6e0 2024-09-16T17:03:39.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:39.014+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7f69c0043bf0 con 0xf059b0 2024-09-16T17:03:39.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:39.014+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7fb4a8045ba0 con 0x7fb4bc06e6e0 2024-09-16T17:03:39.140 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:39.139+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "100"} v 0) -- 0x7fb4bc125310 con 0x7fb4bc06e6e0 2024-09-16T17:03:40.019 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.018+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v702) ==== 225+0+0 (crc 0 0 0) 0x7fb4ac00f2a0 con 0x7fb4bc06e6e0 2024-09-16T17:03:40.019 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_objects = 100 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:03:40.021 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 <== mon.0 v2:172.21.15.59:3300/0 10 ==== osd_map(702..702 src has 403..702) ==== 628+0+0 (crc 0 0 0) 0x7fb4ac011dd0 con 0x7fb4bc06e6e0 2024-09-16T17:03:40.021 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 7 ==== osd_map(702..702 src has 403..702) ==== 628+0+0 (crc 0 0 0) 0x7f69c40030d0 con 0xf059b0 2024-09-16T17:03:40.022 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f69c0043e10 con 0xf059b0 2024-09-16T17:03:40.022 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4b8ff9640 1 -- 172.21.15.59:0/219095750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7fb4a8045c50 con 0x7fb4bc06e6e0 2024-09-16T17:03:40.022 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb4a803e960 msgr2=0x7fb4a8040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb4a803e960 0x7fb4a8040e70 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 msgr2=0x7fb4bc122200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc122200 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 shutdown_connections 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb4a803e960 0x7fb4a8040e70 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.021+0000 7fb4c245c640 1 --2- 172.21.15.59:0/219095750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4bc06e6e0 0x7fb4bc122200 unknown :-1 s=CLOSED pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.022+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 >> 172.21.15.59:0/219095750 conn(0x7fb4bc0a31b0 msgr2=0x7fb4bc0a73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.022+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 shutdown_connections 2024-09-16T17:03:40.023 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:40.022+0000 7fb4c245c640 1 -- 172.21.15.59:0/219095750 wait complete. 2024-09-16T17:03:40.039 INFO:tasks.workunit.client.0.smithi059.stderr:+ wait 95954 2024-09-16T17:03:41.623 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.622+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(703..703 src has 403..703) ==== 628+0+0 (crc 0 0 0) 0x7f69c4010ce0 con 0xf059b0 2024-09-16T17:03:41.623 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.622+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7f69c0044030 con 0xf059b0 2024-09-16T17:03:41.623 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.622+0000 7f69d27fc640 1 -- 172.21.15.59:0/3685396991 --> v2:172.21.15.104:6803/2992308739 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x7f69c0044220 con 0xf064d0 2024-09-16T17:03:41.672 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69da59c640 1 -- 172.21.15.59:0/3685396991 <== osd.2 v2:172.21.15.104:6803/2992308739 1 ==== osd_op_reply(1 onemore [writefull 0~12875] v703'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f69cc00a430 con 0xf064d0 2024-09-16T17:03:41.672 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 >> v2:172.21.15.104:6803/2992308739 conn(0xf064d0 msgr2=0xf9acf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.672 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> v2:172.21.15.104:6803/2992308739 conn(0xf064d0 0xf9acf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.672 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f69c003d1c0 msgr2=0x7f69c003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f69c003d1c0 0x7f69c003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 msgr2=0xef1e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xef1e70 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 shutdown_connections 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> v2:172.21.15.104:6803/2992308739 conn(0xf064d0 0xf9acf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f69c003d1c0 0x7f69c003f6d0 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 --2- 172.21.15.59:0/3685396991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xf059b0 0xef1e70 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 >> 172.21.15.59:0/3685396991 conn(0xd97770 msgr2=0xe6ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 shutdown_connections 2024-09-16T17:03:41.673 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.671+0000 7f69e191eec0 1 -- 172.21.15.59:0/3685396991 wait complete. 2024-09-16T17:03:41.675 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -ne 0 ']' 2024-09-16T17:03:41.675 INFO:tasks.workunit.client.0.smithi059.stderr:+ true 2024-09-16T17:03:41.675 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put twomore /etc/passwd 2024-09-16T17:03:41.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.713+0000 7f339a844ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:41.720 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.719+0000 7f339a844ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:41.720 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.719+0000 7f339a844ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:41.721 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.720+0000 7f339a844ec0 1 Processor -- start 2024-09-16T17:03:41.721 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.720+0000 7f339a844ec0 1 -- start start 2024-09-16T17:03:41.723 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339a844ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1f036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.723 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339a844ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1d4f520 con 0x1de4e30 2024-09-16T17:03:41.723 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339299b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1f036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339299b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1f036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34126/0 (socket says 172.21.15.59:34126) 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339299b640 1 -- 172.21.15.59:0/268489504 learned_addr learned my addr 172.21.15.59:0/268489504 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339299b640 1 -- 172.21.15.59:0/268489504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cebe10 con 0x1de4e30 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.722+0000 7f339299b640 1 --2- 172.21.15.59:0/268489504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1f036c0 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8392601fef823a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f3391198640 1 -- 172.21.15.59:0/268489504 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f337c02dcc0 con 0x1de4e30 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f3391198640 1 -- 172.21.15.59:0/268489504 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f337c037370 con 0x1de4e30 2024-09-16T17:03:41.724 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f3391198640 1 -- 172.21.15.59:0/268489504 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f337c037610 con 0x1de4e30 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 -- 172.21.15.59:0/268489504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 msgr2=0x1f036c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 --2- 172.21.15.59:0/268489504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1f036c0 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 -- 172.21.15.59:0/268489504 shutdown_connections 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 --2- 172.21.15.59:0/268489504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1f036c0 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 -- 172.21.15.59:0/268489504 >> 172.21.15.59:0/268489504 conn(0x1d0f770 msgr2=0x1f067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 -- 172.21.15.59:0/268489504 shutdown_connections 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.723+0000 7f339a844ec0 1 -- 172.21.15.59:0/268489504 wait complete. 2024-09-16T17:03:41.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.724+0000 7f339a844ec0 1 Processor -- start 2024-09-16T17:03:41.726 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.724+0000 7f339a844ec0 1 -- start start 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.726+0000 7f339a844ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1de6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.726+0000 7f339a844ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1d4d280 con 0x1de4e30 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.726+0000 7f339299b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1de6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.726+0000 7f339299b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1de6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34130/0 (socket says 172.21.15.59:34130) 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.726+0000 7f339299b640 1 -- 172.21.15.59:0/3050069618 learned_addr learned my addr 172.21.15.59:0/3050069618 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.726+0000 7f339299b640 1 -- 172.21.15.59:0/3050069618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cdd920 con 0x1de4e30 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.727+0000 7f339299b640 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1de6ea0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.727+0000 7f338bfff640 1 -- 172.21.15.59:0/3050069618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f337c03e040 con 0x1de4e30 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.727+0000 7f338bfff640 1 -- 172.21.15.59:0/3050069618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f337c0374e0 con 0x1de4e30 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.727+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1cdd380 con 0x1de4e30 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.727+0000 7f338bfff640 1 -- 172.21.15.59:0/3050069618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f337c02dcc0 con 0x1de4e30 2024-09-16T17:03:41.728 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.727+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1de87c0 con 0x1de4e30 2024-09-16T17:03:41.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.728+0000 7f338bfff640 1 -- 172.21.15.59:0/3050069618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f337c041040 con 0x1de4e30 2024-09-16T17:03:41.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.728+0000 7f338bfff640 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f337803d1c0 0x7f337803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.729 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.728+0000 7f338bfff640 1 -- 172.21.15.59:0/3050069618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(703..703 src has 403..703) ==== 3819+0+0 (crc 0 0 0) 0x7f337c032040 con 0x1de4e30 2024-09-16T17:03:41.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.728+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> v2:172.21.15.104:6808/851587968 conn(0x1e7ddf0 0x1e76630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.728+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x1e66b80 con 0x1e7ddf0 2024-09-16T17:03:41.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.728+0000 7f339219a640 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f337803d1c0 0x7f337803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:41.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.729+0000 7f339219a640 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f337803d1c0 0x7f337803f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.730 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.729+0000 7f339319c640 1 --2- 172.21.15.59:0/3050069618 >> v2:172.21.15.104:6808/851587968 conn(0x1e7ddf0 0x1e76630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:41.733 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.732+0000 7f339319c640 1 --2- 172.21.15.59:0/3050069618 >> v2:172.21.15.104:6808/851587968 conn(0x1e7ddf0 0x1e76630 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.746 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339319c640 1 -- 172.21.15.59:0/3050069618 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 twomore [writefull 0~12875] v703'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f338400a430 con 0x1e7ddf0 2024-09-16T17:03:41.746 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 >> v2:172.21.15.104:6808/851587968 conn(0x1e7ddf0 msgr2=0x1e76630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.746 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> v2:172.21.15.104:6808/851587968 conn(0x1e7ddf0 0x1e76630 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f337803d1c0 msgr2=0x7f337803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f337803d1c0 0x7f337803f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 msgr2=0x1de6ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1de6ea0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 shutdown_connections 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> v2:172.21.15.104:6808/851587968 conn(0x1e7ddf0 0x1e76630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f337803d1c0 0x7f337803f6d0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 --2- 172.21.15.59:0/3050069618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1de4e30 0x1de6ea0 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 >> 172.21.15.59:0/3050069618 conn(0x1d0f770 msgr2=0x1f06580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 shutdown_connections 2024-09-16T17:03:41.747 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.745+0000 7f339a844ec0 1 -- 172.21.15.59:0/3050069618 wait complete. 2024-09-16T17:03:41.749 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_bytes 100 2024-09-16T17:03:41.845 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.836+0000 7f6b87f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:41.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.846+0000 7f6b87f51640 1 Processor -- start 2024-09-16T17:03:41.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.846+0000 7f6b87f51640 1 -- start start 2024-09-16T17:03:41.849 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.847+0000 7f6b87f51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b801393c0 0x7f6b8013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.849 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.847+0000 7f6b87f51640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b8006dd50 con 0x7f6b8006e6e0 2024-09-16T17:03:41.849 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.847+0000 7f6b87f51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6b8006f200 con 0x7f6b801393c0 2024-09-16T17:03:41.849 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b85ced640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b8006e6e0 0x7f6b8006eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60266/0 (socket says 172.21.15.59:60266) 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b85ced640 1 -- 172.21.15.59:0/1335833672 learned_addr learned my addr 172.21.15.59:0/1335833672 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b854ec640 1 --2- 172.21.15.59:0/1335833672 >> v2:172.21.15.59:3300/0 conn(0x7f6b801393c0 0x7f6b8013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b84ceb640 1 -- 172.21.15.59:0/1335833672 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263978495 0 0) 0x7f6b8006dd50 con 0x7f6b8006e6e0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b84ceb640 1 -- 172.21.15.59:0/1335833672 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6c003580 con 0x7f6b8006e6e0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b854ec640 1 -- 172.21.15.59:0/1335833672 >> v1:172.21.15.59:6789/0 conn(0x7f6b8006e6e0 legacy=0x7f6b8006eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b854ec640 1 -- 172.21.15.59:0/1335833672 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8006f590 con 0x7f6b801393c0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b854ec640 1 --2- 172.21.15.59:0/1335833672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801393c0 0x7f6b8013b7e0 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41387c50c22da71 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b84ceb640 1 -- 172.21.15.59:0/1335833672 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b70009d80 con 0x7f6b801393c0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b84ceb640 1 -- 172.21.15.59:0/1335833672 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b7000e230 con 0x7f6b801393c0 2024-09-16T17:03:41.850 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.848+0000 7f6b84ceb640 1 -- 172.21.15.59:0/1335833672 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b7000e4d0 con 0x7f6b801393c0 2024-09-16T17:03:41.851 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 -- 172.21.15.59:0/1335833672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801393c0 msgr2=0x7f6b8013b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:41.851 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 --2- 172.21.15.59:0/1335833672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801393c0 0x7f6b8013b7e0 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.851 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 -- 172.21.15.59:0/1335833672 shutdown_connections 2024-09-16T17:03:41.851 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 --2- 172.21.15.59:0/1335833672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b801393c0 0x7f6b8013b7e0 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:41.851 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 -- 172.21.15.59:0/1335833672 >> 172.21.15.59:0/1335833672 conn(0x7f6b800a31b0 msgr2=0x7f6b800a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:41.851 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 -- 172.21.15.59:0/1335833672 shutdown_connections 2024-09-16T17:03:41.852 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.849+0000 7f6b87f51640 1 -- 172.21.15.59:0/1335833672 wait complete. 2024-09-16T17:03:41.852 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.850+0000 7f6b87f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:41.852 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.851+0000 7f6b87f51640 1 Processor -- start 2024-09-16T17:03:41.852 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.851+0000 7f6b87f51640 1 -- start start 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b87f51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 0x7f6b801caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b87f51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80122d90 con 0x7f6b8006e6e0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b85ced640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 0x7f6b801caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b85ced640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 0x7f6b801caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34150/0 (socket says 172.21.15.59:34150) 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b85ced640 1 -- 172.21.15.59:0/660705879 learned_addr learned my addr 172.21.15.59:0/660705879 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b85ced640 1 -- 172.21.15.59:0/660705879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b80120cd0 con 0x7f6b8006e6e0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.853+0000 7f6b85ced640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 0x7f6b801caa00 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.854+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b7c005a60 con 0x7f6b8006e6e0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.854+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b7c005bc0 con 0x7f6b8006e6e0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.854+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b80122370 con 0x7f6b8006e6e0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.854+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b7c005e60 con 0x7f6b8006e6e0 2024-09-16T17:03:41.855 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.854+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b80120930 con 0x7f6b8006e6e0 2024-09-16T17:03:41.856 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.855+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6b7c0070b0 con 0x7f6b8006e6e0 2024-09-16T17:03:41.856 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.855+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8006fe30 con 0x7f6b8006e6e0 2024-09-16T17:03:41.856 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.855+0000 7f6b767fc640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6b6403e960 0x7f6b64040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:41.856 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.855+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(703..703 src has 403..703) ==== 3819+0+0 (crc 0 0 0) 0x7f6b7c04faa0 con 0x7f6b8006e6e0 2024-09-16T17:03:41.856 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.855+0000 7f6b854ec640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6b6403e960 0x7f6b64040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:41.857 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.856+0000 7f6b854ec640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6b6403e960 0x7f6b64040e70 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:41.861 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:41.860+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6b7c00dc60 con 0x7f6b8006e6e0 2024-09-16T17:03:42.048 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:42.047+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "100"} v 0) -- 0x7f6b8006a450 con 0x7f6b8006e6e0 2024-09-16T17:03:43.026 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:43.025+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v704) ==== 221+0+0 (crc 0 0 0) 0x7f6b7c00d660 con 0x7f6b8006e6e0 2024-09-16T17:03:43.156 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:43.155+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "100"} v 0) -- 0x7f6b80123d10 con 0x7f6b8006e6e0 2024-09-16T17:03:44.032 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.031+0000 7f6b767fc640 1 -- 172.21.15.59:0/660705879 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v705) ==== 221+0+0 (crc 0 0 0) 0x7f6b7c00d840 con 0x7f6b8006e6e0 2024-09-16T17:03:44.032 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_bytes = 100 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6b6403e960 msgr2=0x7f6b64040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6b6403e960 0x7f6b64040e70 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 msgr2=0x7f6b801caa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 0x7f6b801caa00 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 shutdown_connections 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6b6403e960 0x7f6b64040e70 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:44.035 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 --2- 172.21.15.59:0/660705879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8006e6e0 0x7f6b801caa00 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:44.036 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 >> 172.21.15.59:0/660705879 conn(0x7f6b800a31b0 msgr2=0x7f6b80137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:44.036 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.034+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 shutdown_connections 2024-09-16T17:03:44.036 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:03:44.035+0000 7f6b87f51640 1 -- 172.21.15.59:0/660705879 wait complete. 2024-09-16T17:03:44.051 INFO:tasks.workunit.client.0.smithi059.stderr:+ sleep 30 2024-09-16T17:04:14.053 INFO:tasks.workunit.client.0.smithi059.stderr:+ pid=96045 2024-09-16T17:04:14.054 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_bytes 0 2024-09-16T17:04:14.054 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put two /etc/passwd 2024-09-16T17:04:14.100 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.100+0000 7fda72245ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:14.107 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.106+0000 7fda72245ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:14.107 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.106+0000 7fda72245ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:14.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.108+0000 7fda72245ec0 1 Processor -- start 2024-09-16T17:04:14.108 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.108+0000 7fda72245ec0 1 -- start start 2024-09-16T17:04:14.110 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.109+0000 7fda72245ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.110 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.109+0000 7fda72245ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1a9c520 con 0x1b363d0 2024-09-16T17:04:14.110 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.109+0000 7fda6a39b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:14.110 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.109+0000 7fda6a39b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39732/0 (socket says 172.21.15.59:39732) 2024-09-16T17:04:14.110 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.109+0000 7fda6a39b640 1 -- 172.21.15.59:0/3436304568 learned_addr learned my addr 172.21.15.59:0/3436304568 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:14.111 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.110+0000 7fda6a39b640 1 -- 172.21.15.59:0/3436304568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a38e10 con 0x1b363d0 2024-09-16T17:04:14.111 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.110+0000 7fda6a39b640 1 --2- 172.21.15.59:0/3436304568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bccd90 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77f040ea9cdf4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.111 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.110+0000 7fda68b98640 1 -- 172.21.15.59:0/3436304568 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda5402dc90 con 0x1b363d0 2024-09-16T17:04:14.112 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.110+0000 7fda68b98640 1 -- 172.21.15.59:0/3436304568 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda5402de90 con 0x1b363d0 2024-09-16T17:04:14.112 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.110+0000 7fda68b98640 1 -- 172.21.15.59:0/3436304568 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda5400a170 con 0x1b363d0 2024-09-16T17:04:14.112 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.111+0000 7fda72245ec0 1 -- 172.21.15.59:0/3436304568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 msgr2=0x1bccd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.111+0000 7fda72245ec0 1 --2- 172.21.15.59:0/3436304568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bccd90 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.111+0000 7fda72245ec0 1 -- 172.21.15.59:0/3436304568 shutdown_connections 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.111+0000 7fda72245ec0 1 --2- 172.21.15.59:0/3436304568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bccd90 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.111+0000 7fda72245ec0 1 -- 172.21.15.59:0/3436304568 >> 172.21.15.59:0/3436304568 conn(0x1a5c770 msgr2=0x1b2fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.112+0000 7fda72245ec0 1 -- 172.21.15.59:0/3436304568 shutdown_connections 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.112+0000 7fda72245ec0 1 -- 172.21.15.59:0/3436304568 wait complete. 2024-09-16T17:04:14.113 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.113+0000 7fda72245ec0 1 Processor -- start 2024-09-16T17:04:14.114 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.113+0000 7fda72245ec0 1 -- start start 2024-09-16T17:04:14.116 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.114+0000 7fda72245ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bbb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.114+0000 7fda72245ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1a9a280 con 0x1b363d0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.115+0000 7fda6a39b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bbb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.115+0000 7fda6a39b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bbb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39742/0 (socket says 172.21.15.59:39742) 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.115+0000 7fda6a39b640 1 -- 172.21.15.59:0/2569766129 learned_addr learned my addr 172.21.15.59:0/2569766129 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.115+0000 7fda6a39b640 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a2a920 con 0x1b363d0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.115+0000 7fda6a39b640 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bbb280 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.116+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda54009700 con 0x1b363d0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.116+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda54009860 con 0x1b363d0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.116+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a2a380 con 0x1b363d0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.116+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda54009b00 con 0x1b363d0 2024-09-16T17:04:14.117 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.116+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1bcbe90 con 0x1b363d0 2024-09-16T17:04:14.118 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.117+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fda54009d00 con 0x1b363d0 2024-09-16T17:04:14.118 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.117+0000 7fda62ffd640 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda5003d170 0x7fda5003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.118 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.117+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(706..706 src has 403..706) ==== 3819+0+0 (crc 0 0 0) 0x7fda54032040 con 0x1b363d0 2024-09-16T17:04:14.119 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.117+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7fda50043460 con 0x1b363d0 2024-09-16T17:04:14.119 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.117+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> v2:172.21.15.104:6808/851587968 conn(0x1b36d20 0x1bbbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.119 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.118+0000 7fda69b9a640 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda5003d170 0x7fda5003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:14.119 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.118+0000 7fda69b9a640 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda5003d170 0x7fda5003f680 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.119 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.119+0000 7fda6ab9c640 1 --2- 172.21.15.59:0/2569766129 >> v2:172.21.15.104:6808/851587968 conn(0x1b36d20 0x1bbbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:14.124 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.123+0000 7fda6ab9c640 1 --2- 172.21.15.59:0/2569766129 >> v2:172.21.15.104:6808/851587968 conn(0x1b36d20 0x1bbbcd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.165 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.155+0000 7f2f602fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:14.166 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.165+0000 7f2f602fd640 1 Processor -- start 2024-09-16T17:04:14.166 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.165+0000 7f2f602fd640 1 -- start start 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f602fd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f5809ed30 0x7f2f581362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f602fd640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5809fd50 con 0x7f2f58136800 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f602fd640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5809fa40 con 0x7f2f5809ed30 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5e099640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f5809ed30 0x7f2f581362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5d898640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f58136800 0x7f2f5806ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33134/0 (socket says 172.21.15.59:33134) 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5e099640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f5809ed30 0x7f2f581362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39746/0 (socket says 172.21.15.59:39746) 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5d898640 1 -- 172.21.15.59:0/1802501063 learned_addr learned my addr 172.21.15.59:0/1802501063 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5e099640 1 -- 172.21.15.59:0/1802501063 >> v1:172.21.15.59:6789/0 conn(0x7f2f58136800 legacy=0x7f2f5806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5e099640 1 -- 172.21.15.59:0/1802501063 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5809ffe0 con 0x7f2f5809ed30 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5d097640 1 -- 172.21.15.59:0/1802501063 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111368932 0 0) 0x7f2f5809fd50 con 0x7f2f58136800 2024-09-16T17:04:14.169 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.167+0000 7f2f5e099640 1 --2- 172.21.15.59:0/1802501063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f581362c0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0389367c3cc4a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.170 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f5d097640 1 -- 172.21.15.59:0/1802501063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f5400e040 con 0x7f2f5809ed30 2024-09-16T17:04:14.170 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f5d097640 1 -- 172.21.15.59:0/1802501063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f54007670 con 0x7f2f5809ed30 2024-09-16T17:04:14.170 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f5d097640 1 -- 172.21.15.59:0/1802501063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f54007910 con 0x7f2f5809ed30 2024-09-16T17:04:14.170 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f602fd640 1 -- 172.21.15.59:0/1802501063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 msgr2=0x7f2f581362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f602fd640 1 --2- 172.21.15.59:0/1802501063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f581362c0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f602fd640 1 -- 172.21.15.59:0/1802501063 shutdown_connections 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.168+0000 7f2f602fd640 1 --2- 172.21.15.59:0/1802501063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f581362c0 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.169+0000 7f2f602fd640 1 -- 172.21.15.59:0/1802501063 >> 172.21.15.59:0/1802501063 conn(0x7f2f580a5350 msgr2=0x7f2f580a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.169+0000 7f2f602fd640 1 -- 172.21.15.59:0/1802501063 shutdown_connections 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.169+0000 7f2f602fd640 1 -- 172.21.15.59:0/1802501063 wait complete. 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.169+0000 7f2f602fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:14.171 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.171+0000 7f2f602fd640 1 Processor -- start 2024-09-16T17:04:14.172 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.171+0000 7f2f602fd640 1 -- start start 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.172+0000 7f2f602fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f58120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.172+0000 7f2f602fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f58122e20 con 0x7f2f5809ed30 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.172+0000 7f2f5e099640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f58120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.172+0000 7f2f5e099640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f58120b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39754/0 (socket says 172.21.15.59:39754) 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.172+0000 7f2f5e099640 1 -- 172.21.15.59:0/2428643070 learned_addr learned my addr 172.21.15.59:0/2428643070 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f5e099640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f58124b40 con 0x7f2f5809ed30 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f5e099640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f58120b30 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f5400e040 con 0x7f2f5809ed30 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f54012ab0 con 0x7f2f5809ed30 2024-09-16T17:04:14.174 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f58121ee0 con 0x7f2f5809ed30 2024-09-16T17:04:14.175 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f54012d50 con 0x7f2f5809ed30 2024-09-16T17:04:14.175 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.173+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f58122570 con 0x7f2f5809ed30 2024-09-16T17:04:14.175 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.174+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f581362c0 con 0x7f2f5809ed30 2024-09-16T17:04:14.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.174+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2f540153f0 con 0x7f2f5809ed30 2024-09-16T17:04:14.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.174+0000 7f2f4effd640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2f3c03e930 0x7f2f3c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:14.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.174+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(706..706 src has 403..706) ==== 3819+0+0 (crc 0 0 0) 0x7f2f540515a0 con 0x7f2f5809ed30 2024-09-16T17:04:14.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.174+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f2f3c044bc0 con 0x7f2f5809ed30 2024-09-16T17:04:14.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.175+0000 7f2f5d898640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2f3c03e930 0x7f2f3c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:14.176 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.175+0000 7f2f5d898640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2f3c03e930 0x7f2f3c040e40 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:14.180 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.179+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2f54014710 con 0x7f2f5809ed30 2024-09-16T17:04:14.370 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:14.369+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"} v 0) -- 0x7f2f58076080 con 0x7f2f5809ed30 2024-09-16T17:04:15.009 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:15.007+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v707) ==== 217+0+0 (crc 0 0 0) 0x7f2f5400fe10 con 0x7f2f5809ed30 2024-09-16T17:04:15.009 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:15.008+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 6 ==== osd_map(707..707 src has 403..707) ==== 628+0+0 (crc 0 0 0) 0x7fda54035630 con 0x1b363d0 2024-09-16T17:04:15.009 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:15.008+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(707..707 src has 403..707) ==== 628+0+0 (crc 0 0 0) 0x7f2f5400e360 con 0x7f2f5809ed30 2024-09-16T17:04:15.009 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:15.008+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f2f3c045b00 con 0x7f2f5809ed30 2024-09-16T17:04:15.009 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:15.008+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7fda50043ba0 con 0x1b363d0 2024-09-16T17:04:15.131 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:15.130+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"} v 0) -- 0x7f2f58123390 con 0x7f2f5809ed30 2024-09-16T17:04:16.013 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.012+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v708) ==== 217+0+0 (crc 0 0 0) 0x7f2f5400e1a0 con 0x7f2f5809ed30 2024-09-16T17:04:16.013 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_bytes = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:04:16.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.014+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 7 ==== osd_map(708..708 src has 403..708) ==== 628+0+0 (crc 0 0 0) 0x7fda54007e60 con 0x1b363d0 2024-09-16T17:04:16.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.014+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 <== mon.0 v2:172.21.15.59:3300/0 10 ==== osd_map(708..708 src has 403..708) ==== 628+0+0 (crc 0 0 0) 0x7f2f54009210 con 0x7f2f5809ed30 2024-09-16T17:04:16.015 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.014+0000 7f2f4effd640 1 -- 172.21.15.59:0/2428643070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f2f3c045bb0 con 0x7f2f5809ed30 2024-09-16T17:04:16.016 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.014+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7fda50043dc0 con 0x1b363d0 2024-09-16T17:04:16.016 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2f3c03e930 msgr2=0x7f2f3c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2f3c03e930 0x7f2f3c040e40 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 msgr2=0x7f2f58120b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f58120b30 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 shutdown_connections 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2f3c03e930 0x7f2f3c040e40 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 --2- 172.21.15.59:0/2428643070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f5809ed30 0x7f2f58120b30 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 >> 172.21.15.59:0/2428643070 conn(0x7f2f580a5350 msgr2=0x7f2f581bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 shutdown_connections 2024-09-16T17:04:16.017 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.015+0000 7f2f602fd640 1 -- 172.21.15.59:0/2428643070 wait complete. 2024-09-16T17:04:16.032 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_objects 0 2024-09-16T17:04:16.149 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.139+0000 7f4cb3f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:16.150 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.149+0000 7f4cb3f51640 1 Processor -- start 2024-09-16T17:04:16.150 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.149+0000 7f4cb3f51640 1 -- start start 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb3f51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cac073f60 0x7f4cac13c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb3f51640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac09c9b0 con 0x7f4cac09e710 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb3f51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f4cac06e3b0 con 0x7f4cac073f60 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb14ec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cac073f60 0x7f4cac13c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb1ced640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4cac09e710 0x7f4cac073850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33138/0 (socket says 172.21.15.59:33138) 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb1ced640 1 -- 172.21.15.59:0/1621538869 learned_addr learned my addr 172.21.15.59:0/1621538869 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb14ec640 1 -- 172.21.15.59:0/1621538869 >> v1:172.21.15.59:6789/0 conn(0x7f4cac09e710 legacy=0x7f4cac073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb0ceb640 1 -- 172.21.15.59:0/1621538869 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017961522 0 0) 0x7f4cac09c9b0 con 0x7f4cac09e710 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.151+0000 7f4cb14ec640 1 -- 172.21.15.59:0/1621538869 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac09d190 con 0x7f4cac073f60 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.152+0000 7f4cb14ec640 1 --2- 172.21.15.59:0/1621538869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac13c360 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7224e92a61fde31d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:16.153 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.152+0000 7f4cb0ceb640 1 -- 172.21.15.59:0/1621538869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c9c009d80 con 0x7f4cac073f60 2024-09-16T17:04:16.154 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.152+0000 7f4cb0ceb640 1 -- 172.21.15.59:0/1621538869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c9c00e230 con 0x7f4cac073f60 2024-09-16T17:04:16.154 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.152+0000 7f4cb0ceb640 1 -- 172.21.15.59:0/1621538869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c9c00e4d0 con 0x7f4cac073f60 2024-09-16T17:04:16.154 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.152+0000 7f4cb3f51640 1 -- 172.21.15.59:0/1621538869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 msgr2=0x7f4cac13c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.152+0000 7f4cb3f51640 1 --2- 172.21.15.59:0/1621538869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac13c360 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.153+0000 7f4cb3f51640 1 -- 172.21.15.59:0/1621538869 shutdown_connections 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.153+0000 7f4cb3f51640 1 --2- 172.21.15.59:0/1621538869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac13c360 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.153+0000 7f4cb3f51640 1 -- 172.21.15.59:0/1621538869 >> 172.21.15.59:0/1621538869 conn(0x7f4cac0a30a0 msgr2=0x7f4cac0a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.153+0000 7f4cb3f51640 1 -- 172.21.15.59:0/1621538869 shutdown_connections 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.153+0000 7f4cb3f51640 1 -- 172.21.15.59:0/1621538869 wait complete. 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.153+0000 7f4cb3f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:16.155 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.155+0000 7f4cb3f51640 1 Processor -- start 2024-09-16T17:04:16.156 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.155+0000 7f4cb3f51640 1 -- start start 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.156+0000 7f4cb3f51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac1cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.156+0000 7f4cb3f51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac09b900 con 0x7f4cac073f60 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.156+0000 7f4cb1ced640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac1cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.156+0000 7f4cb1ced640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac1cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39764/0 (socket says 172.21.15.59:39764) 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.156+0000 7f4cb1ced640 1 -- 172.21.15.59:0/4260694038 learned_addr learned my addr 172.21.15.59:0/4260694038 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4cb1ced640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac097930 con 0x7f4cac073f60 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4cb1ced640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac1cabc0 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ca8005a60 con 0x7f4cac073f60 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ca8005bc0 con 0x7f4cac073f60 2024-09-16T17:04:16.158 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac097620 con 0x7f4cac073f60 2024-09-16T17:04:16.159 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ca8005e60 con 0x7f4cac073f60 2024-09-16T17:04:16.159 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.157+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac09b110 con 0x7f4cac073f60 2024-09-16T17:04:16.159 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.158+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac09f670 con 0x7f4cac073f60 2024-09-16T17:04:16.160 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.158+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4ca80070b0 con 0x7f4cac073f60 2024-09-16T17:04:16.160 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.159+0000 7f4ca27fc640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f4c9003e930 0x7f4c90040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:16.160 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.159+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(708..708 src has 403..708) ==== 3819+0+0 (crc 0 0 0) 0x7f4ca804fb10 con 0x7f4cac073f60 2024-09-16T17:04:16.160 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.159+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f4c90044bc0 con 0x7f4cac073f60 2024-09-16T17:04:16.160 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.159+0000 7f4cb14ec640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f4c9003e930 0x7f4c90040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:16.160 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.159+0000 7f4cb14ec640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f4c9003e930 0x7f4c90040e40 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:16.164 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.164+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4ca800f230 con 0x7f4cac073f60 2024-09-16T17:04:16.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.350+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"} v 0) -- 0x7f4cac077c10 con 0x7f4cac073f60 2024-09-16T17:04:16.630 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.629+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v709) ==== 221+0+0 (crc 0 0 0) 0x7f4ca800d660 con 0x7f4cac073f60 2024-09-16T17:04:16.630 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.629+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(709..709 src has 403..709) ==== 628+0+0 (crc 0 0 0) 0x7f4ca800da00 con 0x7f4cac073f60 2024-09-16T17:04:16.630 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.629+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7f4c90045b40 con 0x7f4cac073f60 2024-09-16T17:04:16.631 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.630+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(709..709 src has 403..709) ==== 628+0+0 (crc 0 0 0) 0x7fda54056a90 con 0x1b363d0 2024-09-16T17:04:16.631 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.630+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7fda50043dc0 con 0x1b363d0 2024-09-16T17:04:16.631 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.630+0000 7fda62ffd640 1 -- 172.21.15.59:0/2569766129 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e709) -- 0x7fda50044040 con 0x1b36d20 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda6ab9c640 1 -- 172.21.15.59:0/2569766129 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 two [writefull 0~12875] v709'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fda5c00a430 con 0x1b36d20 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 >> v2:172.21.15.104:6808/851587968 conn(0x1b36d20 msgr2=0x1bbbcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> v2:172.21.15.104:6808/851587968 conn(0x1b36d20 0x1bbbcd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda5003d170 msgr2=0x7fda5003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda5003d170 0x7fda5003f680 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 msgr2=0x1bbb280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bbb280 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 shutdown_connections 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> v2:172.21.15.104:6808/851587968 conn(0x1b36d20 0x1bbbcd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda5003d170 0x7fda5003f680 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 --2- 172.21.15.59:0/2569766129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1b363d0 0x1bbb280 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 >> 172.21.15.59:0/2569766129 conn(0x1a5c770 msgr2=0x1bccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:16.678 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 shutdown_connections 2024-09-16T17:04:16.679 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.676+0000 7fda72245ec0 1 -- 172.21.15.59:0/2569766129 wait complete. 2024-09-16T17:04:16.764 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:16.763+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"} v 0) -- 0x7f4cac1cb8d0 con 0x7f4cac073f60 2024-09-16T17:04:17.631 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.630+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v710) ==== 221+0+0 (crc 0 0 0) 0x7f4ca800d840 con 0x7f4cac073f60 2024-09-16T17:04:17.631 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_objects = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:04:17.632 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.630+0000 7f4ca27fc640 1 -- 172.21.15.59:0/4260694038 <== mon.0 v2:172.21.15.59:3300/0 10 ==== osd_map(710..710 src has 403..710) ==== 628+0+0 (crc 0 0 0) 0x7f4ca800d150 con 0x7f4cac073f60 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f4c9003e930 msgr2=0x7f4c90040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f4c9003e930 0x7f4c90040e40 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 msgr2=0x7f4cac1cabc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac1cabc0 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 shutdown_connections 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f4c9003e930 0x7f4c90040e40 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.633+0000 7f4cb3f51640 1 --2- 172.21.15.59:0/4260694038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cac073f60 0x7f4cac1cabc0 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.634+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 >> 172.21.15.59:0/4260694038 conn(0x7f4cac0a30a0 msgr2=0x7f4cac0a0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:17.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.634+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 shutdown_connections 2024-09-16T17:04:17.636 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.635+0000 7f4cb3f51640 1 -- 172.21.15.59:0/4260694038 wait complete. 2024-09-16T17:04:17.651 INFO:tasks.workunit.client.0.smithi059.stderr:+ wait 96045 2024-09-16T17:04:17.652 INFO:tasks.workunit.client.0.smithi059.stderr:+ '[' 0 -ne 0 ']' 2024-09-16T17:04:17.652 INFO:tasks.workunit.client.0.smithi059.stderr:+ true 2024-09-16T17:04:17.652 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put three /etc/passwd 2024-09-16T17:04:17.701 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.700+0000 7fa4dcc38ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:17.707 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.706+0000 7fa4dcc38ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:17.707 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.706+0000 7fa4dcc38ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:17.708 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.707+0000 7fa4dcc38ec0 1 Processor -- start 2024-09-16T17:04:17.708 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.707+0000 7fa4dcc38ec0 1 -- start start 2024-09-16T17:04:17.710 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4dcc38ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1a92560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.710 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4dcc38ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x18f4520 con 0x1987fc0 2024-09-16T17:04:17.710 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4d4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1a92560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:17.710 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4d4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1a92560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39784/0 (socket says 172.21.15.59:39784) 2024-09-16T17:04:17.711 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4d4d9b640 1 -- 172.21.15.59:0/3557814561 learned_addr learned my addr 172.21.15.59:0/3557814561 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:17.711 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4d4d9b640 1 -- 172.21.15.59:0/3557814561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1890e10 con 0x1987fc0 2024-09-16T17:04:17.711 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4d4d9b640 1 --2- 172.21.15.59:0/3557814561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1a92560 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ba5a79782c16ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.711 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.709+0000 7fa4ceffd640 1 -- 172.21.15.59:0/3557814561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4c000b500 con 0x1987fc0 2024-09-16T17:04:17.711 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4ceffd640 1 -- 172.21.15.59:0/3557814561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa4c000b660 con 0x1987fc0 2024-09-16T17:04:17.711 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4ceffd640 1 -- 172.21.15.59:0/3557814561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4c000b900 con 0x1987fc0 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3557814561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 msgr2=0x1a92560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3557814561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1a92560 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3557814561 shutdown_connections 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3557814561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1a92560 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3557814561 >> 172.21.15.59:0/3557814561 conn(0x18b4770 msgr2=0x1989700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3557814561 shutdown_connections 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.710+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3557814561 wait complete. 2024-09-16T17:04:17.712 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.711+0000 7fa4dcc38ec0 1 Processor -- start 2024-09-16T17:04:17.713 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.711+0000 7fa4dcc38ec0 1 -- start start 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4dcc38ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1aa9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4dcc38ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x18f2280 con 0x1987fc0 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4d4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1aa9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4d4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1aa9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39796/0 (socket says 172.21.15.59:39796) 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4d4d9b640 1 -- 172.21.15.59:0/3023162479 learned_addr learned my addr 172.21.15.59:0/3023162479 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4d4d9b640 1 -- 172.21.15.59:0/3023162479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1882920 con 0x1987fc0 2024-09-16T17:04:17.714 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.713+0000 7fa4d4d9b640 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1aa9070 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.714+0000 7fa4cdffb640 1 -- 172.21.15.59:0/3023162479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4c00111e0 con 0x1987fc0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.714+0000 7fa4cdffb640 1 -- 172.21.15.59:0/3023162479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa4c0011830 con 0x1987fc0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.714+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1882380 con 0x1987fc0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.714+0000 7fa4cdffb640 1 -- 172.21.15.59:0/3023162479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa4c00119a0 con 0x1987fc0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.714+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a97020 con 0x1987fc0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.715+0000 7fa4cdffb640 1 -- 172.21.15.59:0/3023162479 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa4c0011b50 con 0x1987fc0 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.715+0000 7fa4cdffb640 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa4bc03d1c0 0x7fa4bc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.716 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.715+0000 7fa4cdffb640 1 -- 172.21.15.59:0/3023162479 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(710..710 src has 403..710) ==== 3819+0+0 (crc 0 0 0) 0x7fa4c00500f0 con 0x1987fc0 2024-09-16T17:04:17.717 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.715+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> v2:172.21.15.104:6808/851587968 conn(0x1990300 0x1a95cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.717 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.715+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x1a995e0 con 0x1990300 2024-09-16T17:04:17.717 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.715+0000 7fa4cffff640 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa4bc03d1c0 0x7fa4bc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:17.717 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.716+0000 7fa4cffff640 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa4bc03d1c0 0x7fa4bc03f6d0 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.717 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.716+0000 7fa4d559c640 1 --2- 172.21.15.59:0/3023162479 >> v2:172.21.15.104:6808/851587968 conn(0x1990300 0x1a95cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:17.721 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.720+0000 7fa4d559c640 1 --2- 172.21.15.59:0/3023162479 >> v2:172.21.15.104:6808/851587968 conn(0x1990300 0x1a95cb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4d559c640 1 -- 172.21.15.59:0/3023162479 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 three [writefull 0~12875] v710'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa4c800a430 con 0x1990300 2024-09-16T17:04:17.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 >> v2:172.21.15.104:6808/851587968 conn(0x1990300 msgr2=0x1a95cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> v2:172.21.15.104:6808/851587968 conn(0x1990300 0x1a95cb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa4bc03d1c0 msgr2=0x7fa4bc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa4bc03d1c0 0x7fa4bc03f6d0 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 msgr2=0x1aa9070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1aa9070 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 shutdown_connections 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> v2:172.21.15.104:6808/851587968 conn(0x1990300 0x1a95cb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa4bc03d1c0 0x7fa4bc03f6d0 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 --2- 172.21.15.59:0/3023162479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1987fc0 0x1aa9070 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 >> 172.21.15.59:0/3023162479 conn(0x18b4770 msgr2=0x1989700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 shutdown_connections 2024-09-16T17:04:17.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.735+0000 7fa4dcc38ec0 1 -- 172.21.15.59:0/3023162479 wait complete. 2024-09-16T17:04:17.739 INFO:tasks.workunit.client.0.smithi059.stderr:++ uuidgen 2024-09-16T17:04:17.739 INFO:tasks.workunit.client.0.smithi059.stderr:+ pp=9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 2024-09-16T17:04:17.739 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool create 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 12 2024-09-16T17:04:17.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.829+0000 7f27c1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:17.838 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.837+0000 7f27c1b91640 1 Processor -- start 2024-09-16T17:04:17.838 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.838+0000 7f27c1b91640 1 -- start start 2024-09-16T17:04:17.840 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27c1b91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27bc0724d0 0x7f27bc0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.840 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27c1b91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc06c4d0 con 0x7f27bc072e20 2024-09-16T17:04:17.840 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27c1b91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f27bc08ef70 con 0x7f27bc0724d0 2024-09-16T17:04:17.840 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27bb7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27bc0724d0 0x7f27bc0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:17.840 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27bb7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27bc0724d0 0x7f27bc0728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39802/0 (socket says 172.21.15.59:39802) 2024-09-16T17:04:17.840 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27bb7fe640 1 -- 172.21.15.59:0/2666385063 learned_addr learned my addr 172.21.15.59:0/2666385063 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:17.841 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.839+0000 7f27b2ffd640 1 --1- 172.21.15.59:0/2666385063 >> v1:172.21.15.59:6789/0 conn(0x7f27bc072e20 0x7f27bc137740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33148/0 (socket says 172.21.15.59:33148) 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27bb7fe640 1 -- 172.21.15.59:0/2666385063 >> v1:172.21.15.59:6789/0 conn(0x7f27bc072e20 legacy=0x7f27bc137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27baffd640 1 -- 172.21.15.59:0/2666385063 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288492878 0 0) 0x7f27bc06c4d0 con 0x7f27bc072e20 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27bb7fe640 1 -- 172.21.15.59:0/2666385063 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc0736d0 con 0x7f27bc0724d0 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27bb7fe640 1 --2- 172.21.15.59:0/2666385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc0728e0 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c51814024b41f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27baffd640 1 -- 172.21.15.59:0/2666385063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27ac009e50 con 0x7f27bc0724d0 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27baffd640 1 -- 172.21.15.59:0/2666385063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27ac00e230 con 0x7f27bc0724d0 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.840+0000 7f27baffd640 1 -- 172.21.15.59:0/2666385063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27ac00e4d0 con 0x7f27bc0724d0 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 -- 172.21.15.59:0/2666385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 msgr2=0x7f27bc0728e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:17.842 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 --2- 172.21.15.59:0/2666385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc0728e0 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.843 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 -- 172.21.15.59:0/2666385063 shutdown_connections 2024-09-16T17:04:17.843 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 --2- 172.21.15.59:0/2666385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc0728e0 unknown :-1 s=CLOSED pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:17.843 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 -- 172.21.15.59:0/2666385063 >> 172.21.15.59:0/2666385063 conn(0x7f27bc0a5770 msgr2=0x7f27bc0a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:17.843 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 -- 172.21.15.59:0/2666385063 shutdown_connections 2024-09-16T17:04:17.843 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 1 -- 172.21.15.59:0/2666385063 wait complete. 2024-09-16T17:04:17.843 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.841+0000 7f27c1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:17.844 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.843+0000 7f27c1b91640 1 Processor -- start 2024-09-16T17:04:17.844 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.843+0000 7f27c1b91640 1 -- start start 2024-09-16T17:04:17.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.844+0000 7f27c1b91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc09b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.844+0000 7f27c1b91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc071600 con 0x7f27bc0724d0 2024-09-16T17:04:17.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27bb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc09b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:17.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27bb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc09b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39810/0 (socket says 172.21.15.59:39810) 2024-09-16T17:04:17.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27bb7fe640 1 -- 172.21.15.59:0/2866679606 learned_addr learned my addr 172.21.15.59:0/2866679606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:17.846 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27bb7fe640 1 -- 172.21.15.59:0/2866679606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc09ad10 con 0x7f27bc0724d0 2024-09-16T17:04:17.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27bb7fe640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc09b140 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27ac00eda0 con 0x7f27bc0724d0 2024-09-16T17:04:17.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27ac015420 con 0x7f27bc0724d0 2024-09-16T17:04:17.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27ac0156c0 con 0x7f27bc0724d0 2024-09-16T17:04:17.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc09c230 con 0x7f27bc0724d0 2024-09-16T17:04:17.847 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.845+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc09ce30 con 0x7f27bc0724d0 2024-09-16T17:04:17.848 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.846+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f27ac015870 con 0x7f27bc0724d0 2024-09-16T17:04:17.848 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.847+0000 7f27b8ff9640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f279c03e930 0x7f279c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:17.848 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.847+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27bc074340 con 0x7f27bc0724d0 2024-09-16T17:04:17.848 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.847+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(710..710 src has 403..710) ==== 3819+0+0 (crc 0 0 0) 0x7f27ac0510f0 con 0x7f27bc0724d0 2024-09-16T17:04:17.848 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.847+0000 7f27b2ffd640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f279c03e930 0x7f279c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:17.848 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.848+0000 7f27b2ffd640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f279c03e930 0x7f279c040e40 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:17.853 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:17.852+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f27ac014c60 con 0x7f27bc0724d0 2024-09-16T17:04:18.040 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.039+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pg_num": 12} v 0) -- 0x7f27bc06ab00 con 0x7f27bc0724d0 2024-09-16T17:04:18.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.634+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pg_num": 12}]=0 pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' created v711) ==== 176+0+0 (crc 0 0 0) 0x7f27ac0129e0 con 0x7f27bc0724d0 2024-09-16T17:04:18.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.773+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pg_num": 12} v 0) -- 0x7f27bc09e280 con 0x7f27bc0724d0 2024-09-16T17:04:18.774 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.773+0000 7f27b8ff9640 1 -- 172.21.15.59:0/2866679606 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pg_num": 12}]=0 pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' already exists v711) ==== 183+0+0 (crc 0 0 0) 0x7f27ac012bc0 con 0x7f27bc0724d0 2024-09-16T17:04:18.774 INFO:tasks.workunit.client.0.smithi059.stderr:pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' already exists 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f279c03e930 msgr2=0x7f279c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f279c03e930 0x7f279c040e40 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 msgr2=0x7f27bc09b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc09b140 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 shutdown_connections 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f279c03e930 0x7f279c040e40 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 --2- 172.21.15.59:0/2866679606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27bc0724d0 0x7f27bc09b140 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 >> 172.21.15.59:0/2866679606 conn(0x7f27bc0a5770 msgr2=0x7f27bc0919d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 shutdown_connections 2024-09-16T17:04:18.777 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.776+0000 7f27c1b91640 1 -- 172.21.15.59:0/2866679606 wait complete. 2024-09-16T17:04:18.786 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool application enable 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 rados 2024-09-16T17:04:18.884 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.874+0000 7fda23288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:18.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.884+0000 7fda23288640 1 Processor -- start 2024-09-16T17:04:18.885 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.884+0000 7fda23288640 1 -- start start 2024-09-16T17:04:18.888 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda23288640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda1c133a90 0x7fda1c1381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:18.888 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda23288640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1c0a08a0 con 0x7fda1c132f70 2024-09-16T17:04:18.888 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda23288640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fda1c09e990 con 0x7fda1c133a90 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda20823640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda1c133a90 0x7fda1c1381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda21024640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fda1c132f70 0x7fda1c133380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33160/0 (socket says 172.21.15.59:33160) 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda21024640 1 -- 172.21.15.59:0/2959956306 learned_addr learned my addr 172.21.15.59:0/2959956306 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda20823640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda1c133a90 0x7fda1c1381b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39822/0 (socket says 172.21.15.59:39822) 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda20823640 1 -- 172.21.15.59:0/2959956306 >> v1:172.21.15.59:6789/0 conn(0x7fda1c132f70 legacy=0x7fda1c133380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda20823640 1 -- 172.21.15.59:0/2959956306 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c09ee10 con 0x7fda1c133a90 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda13fff640 1 -- 172.21.15.59:0/2959956306 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427285504 0 0) 0x7fda1c0a08a0 con 0x7fda1c132f70 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.886+0000 7fda20823640 1 --2- 172.21.15.59:0/2959956306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c133a90 0x7fda1c1381b0 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8213692f88a6dad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda13fff640 1 -- 172.21.15.59:0/2959956306 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda0c009d90 con 0x7fda1c133a90 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda13fff640 1 -- 172.21.15.59:0/2959956306 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda0c00e230 con 0x7fda1c133a90 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda13fff640 1 -- 172.21.15.59:0/2959956306 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda0c00e4d0 con 0x7fda1c133a90 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 -- 172.21.15.59:0/2959956306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c133a90 msgr2=0x7fda1c1381b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:18.889 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 --2- 172.21.15.59:0/2959956306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c133a90 0x7fda1c1381b0 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 -- 172.21.15.59:0/2959956306 shutdown_connections 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 --2- 172.21.15.59:0/2959956306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c133a90 0x7fda1c1381b0 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 -- 172.21.15.59:0/2959956306 >> 172.21.15.59:0/2959956306 conn(0x7fda1c09d9e0 msgr2=0x7fda1c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 -- 172.21.15.59:0/2959956306 shutdown_connections 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.887+0000 7fda23288640 1 -- 172.21.15.59:0/2959956306 wait complete. 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.888+0000 7fda23288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.889+0000 7fda23288640 1 Processor -- start 2024-09-16T17:04:18.890 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.889+0000 7fda23288640 1 -- start start 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda23288640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 0x7fda1c121ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda23288640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c132dc0 con 0x7fda1c132f70 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda21024640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 0x7fda1c121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda21024640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 0x7fda1c121ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39824/0 (socket says 172.21.15.59:39824) 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda21024640 1 -- 172.21.15.59:0/453304809 learned_addr learned my addr 172.21.15.59:0/453304809 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda21024640 1 -- 172.21.15.59:0/453304809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c124a20 con 0x7fda1c132f70 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.891+0000 7fda21024640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 0x7fda1c121ae0 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.892+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda18004b80 con 0x7fda1c132f70 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.892+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda18004ce0 con 0x7fda1c132f70 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.892+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c123190 con 0x7fda1c132f70 2024-09-16T17:04:18.893 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.892+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda18007120 con 0x7fda1c132f70 2024-09-16T17:04:18.894 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.892+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c0a0f70 con 0x7fda1c132f70 2024-09-16T17:04:18.894 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.893+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1c133380 con 0x7fda1c132f70 2024-09-16T17:04:18.894 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.893+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fda180072d0 con 0x7fda1c132f70 2024-09-16T17:04:18.894 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.893+0000 7fda11ffb640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda0003e930 0x7fda00040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:18.894 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.893+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(711..711 src has 403..711) ==== 4194+0+0 (crc 0 0 0) 0x7fda1804fdc0 con 0x7fda1c132f70 2024-09-16T17:04:18.895 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.894+0000 7fda20823640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda0003e930 0x7fda00040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:18.895 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.894+0000 7fda20823640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda0003e930 0x7fda00040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:18.900 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:18.899+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fda1800f230 con 0x7fda1c132f70 2024-09-16T17:04:19.085 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:19.084+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "app": "rados"} v 0) -- 0x7fda1c0a15a0 con 0x7fda1c132f70 2024-09-16T17:04:19.639 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:19.638+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "app": "rados"}]=0 enabled application 'rados' on pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' v712) ==== 213+0+0 (crc 0 0 0) 0x7fda1800a0c0 con 0x7fda1c132f70 2024-09-16T17:04:19.799 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:19.798+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "app": "rados"} v 0) -- 0x7fda1c0008d0 con 0x7fda1c132f70 2024-09-16T17:04:20.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.642+0000 7fda11ffb640 1 -- 172.21.15.59:0/453304809 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "app": "rados"}]=0 enabled application 'rados' on pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' v713) ==== 213+0+0 (crc 0 0 0) 0x7fda1800a7b0 con 0x7fda1c132f70 2024-09-16T17:04:20.644 INFO:tasks.workunit.client.0.smithi059.stderr:enabled application 'rados' on pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' 2024-09-16T17:04:20.648 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.647+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda0003e930 msgr2=0x7fda00040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:20.648 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.647+0000 7fda23288640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda0003e930 0x7fda00040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:20.648 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.647+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 msgr2=0x7fda1c121ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:20.648 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.647+0000 7fda23288640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 0x7fda1c121ae0 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:20.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.648+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 shutdown_connections 2024-09-16T17:04:20.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.648+0000 7fda23288640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fda0003e930 0x7fda00040e40 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:20.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.648+0000 7fda23288640 1 --2- 172.21.15.59:0/453304809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda1c132f70 0x7fda1c121ae0 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:20.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.648+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 >> 172.21.15.59:0/453304809 conn(0x7fda1c09d9e0 msgr2=0x7fda1c071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:20.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.648+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 shutdown_connections 2024-09-16T17:04:20.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.648+0000 7fda23288640 1 -- 172.21.15.59:0/453304809 wait complete. 2024-09-16T17:04:20.666 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 max_objects 10 2024-09-16T17:04:20.781 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.770+0000 7fbd68d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:20.782 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.782+0000 7fbd68d11640 1 Processor -- start 2024-09-16T17:04:20.782 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.782+0000 7fbd68d11640 1 -- start start 2024-09-16T17:04:20.785 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.783+0000 7fbd68d11640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd6409c830 0x7fbd6409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:20.785 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd68d11640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6406ea50 con 0x7fbd641322c0 2024-09-16T17:04:20.785 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd68d11640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6409d6e0 con 0x7fbd6409c830 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd6259c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd6409c830 0x7fbd6409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd6259c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd6409c830 0x7fbd6409cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37660/0 (socket says 172.21.15.59:37660) 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd59d9b640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbd641322c0 0x7fbd641326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58690/0 (socket says 172.21.15.59:58690) 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd6259c640 1 -- 172.21.15.59:0/3185758086 learned_addr learned my addr 172.21.15.59:0/3185758086 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd6259c640 1 -- 172.21.15.59:0/3185758086 >> v1:172.21.15.59:6789/0 conn(0x7fbd641322c0 legacy=0x7fbd641326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd6259c640 1 -- 172.21.15.59:0/3185758086 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6409c520 con 0x7fbd6409c830 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd6259c640 1 --2- 172.21.15.59:0/3185758086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd6409cc40 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2659ee671afe4969 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.784+0000 7fbd61d9b640 1 -- 172.21.15.59:0/3185758086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd54009e40 con 0x7fbd6409c830 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.785+0000 7fbd61d9b640 1 -- 172.21.15.59:0/3185758086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd540103b0 con 0x7fbd6409c830 2024-09-16T17:04:20.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.785+0000 7fbd61d9b640 1 -- 172.21.15.59:0/3185758086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd54010650 con 0x7fbd6409c830 2024-09-16T17:04:20.787 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.785+0000 7fbd68d11640 1 -- 172.21.15.59:0/3185758086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 msgr2=0x7fbd6409cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:20.787 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.785+0000 7fbd68d11640 1 --2- 172.21.15.59:0/3185758086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd6409cc40 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:20.787 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.786+0000 7fbd68d11640 1 -- 172.21.15.59:0/3185758086 shutdown_connections 2024-09-16T17:04:20.787 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.786+0000 7fbd68d11640 1 --2- 172.21.15.59:0/3185758086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd6409cc40 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:20.787 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.786+0000 7fbd68d11640 1 -- 172.21.15.59:0/3185758086 >> 172.21.15.59:0/3185758086 conn(0x7fbd640a2000 msgr2=0x7fbd640a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:20.787 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.786+0000 7fbd68d11640 1 -- 172.21.15.59:0/3185758086 shutdown_connections 2024-09-16T17:04:20.788 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.786+0000 7fbd68d11640 1 -- 172.21.15.59:0/3185758086 wait complete. 2024-09-16T17:04:20.788 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.786+0000 7fbd68d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:20.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.789+0000 7fbd68d11640 1 Processor -- start 2024-09-16T17:04:20.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.789+0000 7fbd68d11640 1 -- start start 2024-09-16T17:04:20.792 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.791+0000 7fbd68d11640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd64131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:20.792 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.791+0000 7fbd68d11640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6409bf00 con 0x7fbd6409c830 2024-09-16T17:04:20.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.791+0000 7fbd6259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd64131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:20.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd6259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd64131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37666/0 (socket says 172.21.15.59:37666) 2024-09-16T17:04:20.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd6259c640 1 -- 172.21.15.59:0/3213176120 learned_addr learned my addr 172.21.15.59:0/3213176120 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd6259c640 1 -- 172.21.15.59:0/3213176120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6409fc80 con 0x7fbd6409c830 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd6259c640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd64131d40 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd54017040 con 0x7fbd6409c830 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd54010ec0 con 0x7fbd6409c830 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6412f8a0 con 0x7fbd6409c830 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd54011550 con 0x7fbd6409c830 2024-09-16T17:04:20.794 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.792+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd641300d0 con 0x7fbd6409c830 2024-09-16T17:04:20.795 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.794+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6409b600 con 0x7fbd6409c830 2024-09-16T17:04:20.795 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.794+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbd5401a040 con 0x7fbd6409c830 2024-09-16T17:04:20.795 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.794+0000 7fbd5b7fe640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbd4403e8e0 0x7fbd44040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:20.795 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.794+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(713..713 src has 403..713) ==== 4207+0+0 (crc 0 0 0) 0x7fbd54051c70 con 0x7fbd6409c830 2024-09-16T17:04:20.795 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.794+0000 7fbd59d9b640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbd4403e8e0 0x7fbd44040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:20.796 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.795+0000 7fbd59d9b640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbd4403e8e0 0x7fbd44040df0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:20.802 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:20.802+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbd54085cd0 con 0x7fbd6409c830 2024-09-16T17:04:21.001 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:21.000+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "field": "max_objects", "val": "10"} v 0) -- 0x7fbd64077c10 con 0x7fbd6409c830 2024-09-16T17:04:21.631 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:21.630+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 v714) ==== 223+0+0 (crc 0 0 0) 0x7fbd54018610 con 0x7fbd6409c830 2024-09-16T17:04:21.765 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:21.764+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "field": "max_objects", "val": "10"} v 0) -- 0x7fbd6409e220 con 0x7fbd6409c830 2024-09-16T17:04:22.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.648+0000 7fbd5b7fe640 1 -- 172.21.15.59:0/3213176120 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 v715) ==== 223+0+0 (crc 0 0 0) 0x7fbd5400d260 con 0x7fbd6409c830 2024-09-16T17:04:22.649 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_objects = 10 for pool 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 2024-09-16T17:04:22.653 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbd4403e8e0 msgr2=0x7fbd44040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbd4403e8e0 0x7fbd44040df0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 msgr2=0x7fbd64131d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd64131d40 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 shutdown_connections 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbd4403e8e0 0x7fbd44040df0 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 --2- 172.21.15.59:0/3213176120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6409c830 0x7fbd64131d40 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.652+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 >> 172.21.15.59:0/3213176120 conn(0x7fbd640a2000 msgr2=0x7fbd640713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.653+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 shutdown_connections 2024-09-16T17:04:22.654 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:22.653+0000 7fbd68d11640 1 -- 172.21.15.59:0/3213176120 wait complete. 2024-09-16T17:04:22.673 INFO:tasks.workunit.client.0.smithi059.stderr:+ sleep 30 2024-09-16T17:04:52.676 INFO:tasks.workunit.client.0.smithi059.stderr:++ seq 1 10 2024-09-16T17:04:52.677 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:52.677 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj1 /etc/passwd 2024-09-16T17:04:52.725 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.724+0000 7f8e9fe36ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.730+0000 7f8e9fe36ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.731 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.730+0000 7f8e9fe36ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.732 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.731+0000 7f8e9fe36ec0 1 Processor -- start 2024-09-16T17:04:52.732 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.731+0000 7f8e9fe36ec0 1 -- start start 2024-09-16T17:04:52.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e9fe36ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e9fe36ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xa8b520 con 0xb20cc0 2024-09-16T17:04:52.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35562/0 (socket says 172.21.15.59:35562) 2024-09-16T17:04:52.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e92ffd640 1 -- 172.21.15.59:0/2005348158 learned_addr learned my addr 172.21.15.59:0/2005348158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.734 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e92ffd640 1 -- 172.21.15.59:0/2005348158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa27e10 con 0xb20cc0 2024-09-16T17:04:52.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e92ffd640 1 --2- 172.21.15.59:0/2005348158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc405a0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650716e3d4c4b822 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.733+0000 7f8e917fa640 1 -- 172.21.15.59:0/2005348158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e840061f0 con 0xb20cc0 2024-09-16T17:04:52.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e917fa640 1 -- 172.21.15.59:0/2005348158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8e84001980 con 0xb20cc0 2024-09-16T17:04:52.735 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e917fa640 1 -- 172.21.15.59:0/2005348158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e84001af0 con 0xb20cc0 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/2005348158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 msgr2=0xc405a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/2005348158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc405a0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/2005348158 shutdown_connections 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/2005348158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc405a0 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/2005348158 >> 172.21.15.59:0/2005348158 conn(0xa4b770 msgr2=0xb2b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/2005348158 shutdown_connections 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.734+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/2005348158 wait complete. 2024-09-16T17:04:52.736 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.735+0000 7f8e9fe36ec0 1 Processor -- start 2024-09-16T17:04:52.737 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.735+0000 7f8e9fe36ec0 1 -- start start 2024-09-16T17:04:52.738 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.737+0000 7f8e9fe36ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc4e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.738 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.737+0000 7f8e9fe36ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xa89280 con 0xb20cc0 2024-09-16T17:04:52.738 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.737+0000 7f8e92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc4e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.738 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.737+0000 7f8e92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc4e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35566/0 (socket says 172.21.15.59:35566) 2024-09-16T17:04:52.738 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.737+0000 7f8e92ffd640 1 -- 172.21.15.59:0/1609687492 learned_addr learned my addr 172.21.15.59:0/1609687492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.739 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.737+0000 7f8e92ffd640 1 -- 172.21.15.59:0/1609687492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa19920 con 0xb20cc0 2024-09-16T17:04:52.739 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.738+0000 7f8e92ffd640 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc4e5f0 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.739 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.738+0000 7f8e7bfff640 1 -- 172.21.15.59:0/1609687492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e84011d70 con 0xb20cc0 2024-09-16T17:04:52.739 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.738+0000 7f8e7bfff640 1 -- 172.21.15.59:0/1609687492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8e84012330 con 0xb20cc0 2024-09-16T17:04:52.739 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.738+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa19380 con 0xb20cc0 2024-09-16T17:04:52.740 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.738+0000 7f8e7bfff640 1 -- 172.21.15.59:0/1609687492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e840124a0 con 0xb20cc0 2024-09-16T17:04:52.740 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.738+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb23310 con 0xb20cc0 2024-09-16T17:04:52.740 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.739+0000 7f8e7bfff640 1 -- 172.21.15.59:0/1609687492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8e840126a0 con 0xb20cc0 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.739+0000 7f8e7bfff640 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8e8003d170 0x7f8e8003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.739+0000 7f8e7bfff640 1 -- 172.21.15.59:0/1609687492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7f8e8404fc50 con 0xb20cc0 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.740+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> v2:172.21.15.104:6808/851587968 conn(0xbba0c0 0xbb2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.740+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xb26b50 con 0xbba0c0 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.740+0000 7f8e927fc640 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8e8003d170 0x7f8e8003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.740+0000 7f8e927fc640 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8e8003d170 0x7f8e8003f680 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.741 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.740+0000 7f8e937fe640 1 --2- 172.21.15.59:0/1609687492 >> v2:172.21.15.104:6808/851587968 conn(0xbba0c0 0xbb2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:52.744 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.743+0000 7f8e937fe640 1 --2- 172.21.15.59:0/1609687492 >> v2:172.21.15.104:6808/851587968 conn(0xbba0c0 0xbb2a50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.762 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e937fe640 1 -- 172.21.15.59:0/1609687492 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8e8c00c430 con 0xbba0c0 2024-09-16T17:04:52.762 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 >> v2:172.21.15.104:6808/851587968 conn(0xbba0c0 msgr2=0xbb2a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.762 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> v2:172.21.15.104:6808/851587968 conn(0xbba0c0 0xbb2a50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.762 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8e8003d170 msgr2=0x7f8e8003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.762 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8e8003d170 0x7f8e8003f680 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 msgr2=0xc4e5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc4e5f0 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 shutdown_connections 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> v2:172.21.15.104:6808/851587968 conn(0xbba0c0 0xbb2a50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f8e8003d170 0x7f8e8003f680 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 --2- 172.21.15.59:0/1609687492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xb20cc0 0xc4e5f0 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 >> 172.21.15.59:0/1609687492 conn(0xa4b770 msgr2=0xc420f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 shutdown_connections 2024-09-16T17:04:52.763 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.761+0000 7f8e9fe36ec0 1 -- 172.21.15.59:0/1609687492 wait complete. 2024-09-16T17:04:52.765 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:52.765 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj2 /etc/passwd 2024-09-16T17:04:52.818 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.817+0000 7efec8e2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.825 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.825+0000 7efec8e2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.826 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.825+0000 7efec8e2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.826 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.826+0000 7efec8e2bec0 1 Processor -- start 2024-09-16T17:04:52.826 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.826+0000 7efec8e2bec0 1 -- start start 2024-09-16T17:04:52.828 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.827+0000 7efec8e2bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2401850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.828 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.827+0000 7efec8e2bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x22e8520 con 0x24169b0 2024-09-16T17:04:52.828 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.827+0000 7efec0e3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2401850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.828 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.827+0000 7efec0e3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2401850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35590/0 (socket says 172.21.15.59:35590) 2024-09-16T17:04:52.828 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.827+0000 7efec0e3f640 1 -- 172.21.15.59:0/182639129 learned_addr learned my addr 172.21.15.59:0/182639129 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.829 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.828+0000 7efec0e3f640 1 -- 172.21.15.59:0/182639129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2284e10 con 0x24169b0 2024-09-16T17:04:52.829 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.828+0000 7efec0e3f640 1 --2- 172.21.15.59:0/182639129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2401850 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7195bfbe76a5a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.829 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.828+0000 7efeba7fc640 1 -- 172.21.15.59:0/182639129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efeac00c490 con 0x24169b0 2024-09-16T17:04:52.829 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.828+0000 7efeba7fc640 1 -- 172.21.15.59:0/182639129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efeac00c5f0 con 0x24169b0 2024-09-16T17:04:52.829 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.828+0000 7efeba7fc640 1 -- 172.21.15.59:0/182639129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efeac00c890 con 0x24169b0 2024-09-16T17:04:52.830 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 -- 172.21.15.59:0/182639129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 msgr2=0x2401850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.830 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/182639129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2401850 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.830 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 -- 172.21.15.59:0/182639129 shutdown_connections 2024-09-16T17:04:52.830 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/182639129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2401850 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.831 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 -- 172.21.15.59:0/182639129 >> 172.21.15.59:0/182639129 conn(0x22a8770 msgr2=0x23879b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.831 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 -- 172.21.15.59:0/182639129 shutdown_connections 2024-09-16T17:04:52.831 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.829+0000 7efec8e2bec0 1 -- 172.21.15.59:0/182639129 wait complete. 2024-09-16T17:04:52.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.831+0000 7efec8e2bec0 1 Processor -- start 2024-09-16T17:04:52.832 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.831+0000 7efec8e2bec0 1 -- start start 2024-09-16T17:04:52.834 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.833+0000 7efec8e2bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2404d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.834 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.833+0000 7efec8e2bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x22e6280 con 0x24169b0 2024-09-16T17:04:52.834 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.833+0000 7efec0e3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2404d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.835 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efec0e3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2404d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35598/0 (socket says 172.21.15.59:35598) 2024-09-16T17:04:52.835 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efec0e3f640 1 -- 172.21.15.59:0/2915020118 learned_addr learned my addr 172.21.15.59:0/2915020118 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efec0e3f640 1 -- 172.21.15.59:0/2915020118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2276920 con 0x24169b0 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efec0e3f640 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2404d50 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efeb97fa640 1 -- 172.21.15.59:0/2915020118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efeac0111e0 con 0x24169b0 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2276380 con 0x24169b0 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efeb97fa640 1 -- 172.21.15.59:0/2915020118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efeac0119d0 con 0x24169b0 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.834+0000 7efeb97fa640 1 -- 172.21.15.59:0/2915020118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efeac011b40 con 0x24169b0 2024-09-16T17:04:52.836 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.835+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x24081e0 con 0x24169b0 2024-09-16T17:04:52.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.835+0000 7efeb97fa640 1 -- 172.21.15.59:0/2915020118 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efeac011d40 con 0x24169b0 2024-09-16T17:04:52.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.836+0000 7efeb97fa640 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803d170 0x7efea803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.836+0000 7efeb97fa640 1 -- 172.21.15.59:0/2915020118 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7efeac050460 con 0x24169b0 2024-09-16T17:04:52.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.836+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> v2:172.21.15.104:6808/851587968 conn(0x24174d0 0x28afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.836+0000 7efebb7fe640 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803d170 0x7efea803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.837 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.836+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x2408770 con 0x24174d0 2024-09-16T17:04:52.838 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.837+0000 7efebb7fe640 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803d170 0x7efea803f680 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.838 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.837+0000 7efec1640640 1 --2- 172.21.15.59:0/2915020118 >> v2:172.21.15.104:6808/851587968 conn(0x24174d0 0x28afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:52.841 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.840+0000 7efec1640640 1 --2- 172.21.15.59:0/2915020118 >> v2:172.21.15.104:6808/851587968 conn(0x24174d0 0x28afa00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec1640640 1 -- 172.21.15.59:0/2915020118 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7efeb400a430 con 0x24174d0 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 >> v2:172.21.15.104:6808/851587968 conn(0x24174d0 msgr2=0x28afa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> v2:172.21.15.104:6808/851587968 conn(0x24174d0 0x28afa00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803d170 msgr2=0x7efea803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803d170 0x7efea803f680 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 msgr2=0x2404d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2404d50 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 shutdown_connections 2024-09-16T17:04:52.859 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> v2:172.21.15.104:6808/851587968 conn(0x24174d0 0x28afa00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.860 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7efea803d170 0x7efea803f680 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.860 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 --2- 172.21.15.59:0/2915020118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x24169b0 0x2404d50 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.860 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 >> 172.21.15.59:0/2915020118 conn(0x22a8770 msgr2=0x2381140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.860 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 shutdown_connections 2024-09-16T17:04:52.860 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.857+0000 7efec8e2bec0 1 -- 172.21.15.59:0/2915020118 wait complete. 2024-09-16T17:04:52.862 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:52.862 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj3 /etc/passwd 2024-09-16T17:04:52.901 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.900+0000 7fd6e882bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.906+0000 7fd6e882bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.907 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.906+0000 7fd6e882bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.907 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.907+0000 7fd6e882bec0 1 Processor -- start 2024-09-16T17:04:52.907 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.907+0000 7fd6e882bec0 1 -- start start 2024-09-16T17:04:52.909 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.908+0000 7fd6e882bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.909 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.908+0000 7fd6e882bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1a7f520 con 0x1bad9b0 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.908+0000 7fd6e099b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.908+0000 7fd6e099b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35612/0 (socket says 172.21.15.59:35612) 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.908+0000 7fd6e099b640 1 -- 172.21.15.59:0/3788804575 learned_addr learned my addr 172.21.15.59:0/3788804575 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.908+0000 7fd6e099b640 1 -- 172.21.15.59:0/3788804575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a1be10 con 0x1bad9b0 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e099b640 1 --2- 172.21.15.59:0/3788804575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c358f0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6582f8dadd356f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6da7fc640 1 -- 172.21.15.59:0/3788804575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6cc00c5e0 con 0x1bad9b0 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6da7fc640 1 -- 172.21.15.59:0/3788804575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6cc00c740 con 0x1bad9b0 2024-09-16T17:04:52.910 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6da7fc640 1 -- 172.21.15.59:0/3788804575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6cc00c9e0 con 0x1bad9b0 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 -- 172.21.15.59:0/3788804575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 msgr2=0x1c358f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/3788804575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c358f0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 -- 172.21.15.59:0/3788804575 shutdown_connections 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/3788804575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c358f0 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 -- 172.21.15.59:0/3788804575 >> 172.21.15.59:0/3788804575 conn(0x1a3f770 msgr2=0x1b182b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 -- 172.21.15.59:0/3788804575 shutdown_connections 2024-09-16T17:04:52.911 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.909+0000 7fd6e882bec0 1 -- 172.21.15.59:0/3788804575 wait complete. 2024-09-16T17:04:52.912 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.910+0000 7fd6e882bec0 1 Processor -- start 2024-09-16T17:04:52.912 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.910+0000 7fd6e882bec0 1 -- start start 2024-09-16T17:04:52.913 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e882bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c42810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.913 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e882bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1a7d280 con 0x1bad9b0 2024-09-16T17:04:52.913 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e099b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c42810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e099b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c42810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35628/0 (socket says 172.21.15.59:35628) 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e099b640 1 -- 172.21.15.59:0/1298088686 learned_addr learned my addr 172.21.15.59:0/1298088686 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e099b640 1 -- 172.21.15.59:0/1298088686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a0d920 con 0x1bad9b0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.912+0000 7fd6e099b640 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c42810 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.913+0000 7fd6d97fa640 1 -- 172.21.15.59:0/1298088686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6cc013a70 con 0x1bad9b0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.913+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a0d380 con 0x1bad9b0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.913+0000 7fd6d97fa640 1 -- 172.21.15.59:0/1298088686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6cc013bd0 con 0x1bad9b0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.913+0000 7fd6d97fa640 1 -- 172.21.15.59:0/1298088686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6cc013e70 con 0x1bad9b0 2024-09-16T17:04:52.914 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.913+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1bad800 con 0x1bad9b0 2024-09-16T17:04:52.915 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.914+0000 7fd6d97fa640 1 -- 172.21.15.59:0/1298088686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd6cc010400 con 0x1bad9b0 2024-09-16T17:04:52.915 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.914+0000 7fd6d97fa640 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd6c803d170 0x7fd6c803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.915 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.914+0000 7fd6d97fa640 1 -- 172.21.15.59:0/1298088686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7fd6cc008040 con 0x1bad9b0 2024-09-16T17:04:52.915 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.914+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> v2:172.21.15.59:6811/1210870840 conn(0x1bae4d0 0x1bac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.915 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.914+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x1b9ca80 con 0x1bae4d0 2024-09-16T17:04:52.915 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.914+0000 7fd6db7fe640 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd6c803d170 0x7fd6c803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.916 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.915+0000 7fd6db7fe640 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd6c803d170 0x7fd6c803f680 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.916 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.915+0000 7fd6e119c640 1 --2- 172.21.15.59:0/1298088686 >> v2:172.21.15.59:6811/1210870840 conn(0x1bae4d0 0x1bac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:52.919 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.919+0000 7fd6e119c640 1 --2- 172.21.15.59:0/1298088686 >> v2:172.21.15.59:6811/1210870840 conn(0x1bae4d0 0x1bac510 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e119c640 1 -- 172.21.15.59:0/1298088686 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd6d400a430 con 0x1bae4d0 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 >> v2:172.21.15.59:6811/1210870840 conn(0x1bae4d0 msgr2=0x1bac510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> v2:172.21.15.59:6811/1210870840 conn(0x1bae4d0 0x1bac510 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd6c803d170 msgr2=0x7fd6c803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd6c803d170 0x7fd6c803f680 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 msgr2=0x1c42810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c42810 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 shutdown_connections 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> v2:172.21.15.59:6811/1210870840 conn(0x1bae4d0 0x1bac510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd6c803d170 0x7fd6c803f680 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.934 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 --2- 172.21.15.59:0/1298088686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1bad9b0 0x1c42810 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.935 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 >> 172.21.15.59:0/1298088686 conn(0x1a3f770 msgr2=0x1b182b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.935 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 shutdown_connections 2024-09-16T17:04:52.935 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.932+0000 7fd6e882bec0 1 -- 172.21.15.59:0/1298088686 wait complete. 2024-09-16T17:04:52.936 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:52.936 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj4 /etc/passwd 2024-09-16T17:04:52.974 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.973+0000 7fdc77522ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.980 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.979+0000 7fdc77522ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.980 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.979+0000 7fdc77522ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:52.981 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.980+0000 7fdc77522ec0 1 Processor -- start 2024-09-16T17:04:52.981 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.980+0000 7fdc77522ec0 1 -- start start 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.981+0000 7fdc77522ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xd26070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.981+0000 7fdc77522ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xc8d520 con 0xd20fc0 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xd26070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xd26070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35642/0 (socket says 172.21.15.59:35642) 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc6b7fe640 1 -- 172.21.15.59:0/1684489312 learned_addr learned my addr 172.21.15.59:0/1684489312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc6b7fe640 1 -- 172.21.15.59:0/1684489312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xc29e10 con 0xd20fc0 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc6b7fe640 1 --2- 172.21.15.59:0/1684489312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xd26070 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9999b17e8c43732a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc69ffb640 1 -- 172.21.15.59:0/1684489312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc58032040 con 0xd20fc0 2024-09-16T17:04:52.983 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc69ffb640 1 -- 172.21.15.59:0/1684489312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc58033040 con 0xd20fc0 2024-09-16T17:04:52.984 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.982+0000 7fdc69ffb640 1 -- 172.21.15.59:0/1684489312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc5802dd10 con 0xd20fc0 2024-09-16T17:04:52.984 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 -- 172.21.15.59:0/1684489312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 msgr2=0xd26070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/1684489312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xd26070 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 -- 172.21.15.59:0/1684489312 shutdown_connections 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/1684489312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xd26070 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 -- 172.21.15.59:0/1684489312 >> 172.21.15.59:0/1684489312 conn(0xc4d770 msgr2=0xd24d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 -- 172.21.15.59:0/1684489312 shutdown_connections 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.983+0000 7fdc77522ec0 1 -- 172.21.15.59:0/1684489312 wait complete. 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.984+0000 7fdc77522ec0 1 Processor -- start 2024-09-16T17:04:52.985 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.984+0000 7fdc77522ec0 1 -- start start 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.985+0000 7fdc77522ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xe2f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.985+0000 7fdc77522ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0xc8b280 con 0xd20fc0 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xe2f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc6b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xe2f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35652/0 (socket says 172.21.15.59:35652) 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc6b7fe640 1 -- 172.21.15.59:0/457536496 learned_addr learned my addr 172.21.15.59:0/457536496 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc6b7fe640 1 -- 172.21.15.59:0/457536496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xc1b920 con 0xd20fc0 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc6b7fe640 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xe2f780 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.987 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc68ff9640 1 -- 172.21.15.59:0/457536496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc58032040 con 0xd20fc0 2024-09-16T17:04:52.988 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc68ff9640 1 -- 172.21.15.59:0/457536496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc58036570 con 0xd20fc0 2024-09-16T17:04:52.988 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xc1b380 con 0xd20fc0 2024-09-16T17:04:52.988 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc68ff9640 1 -- 172.21.15.59:0/457536496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc58036810 con 0xd20fc0 2024-09-16T17:04:52.988 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.986+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe32ca0 con 0xd20fc0 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.987+0000 7fdc68ff9640 1 -- 172.21.15.59:0/457536496 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdc58003040 con 0xd20fc0 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.987+0000 7fdc68ff9640 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fdc4803d1c0 0x7fdc4803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.987+0000 7fdc68ff9640 1 -- 172.21.15.59:0/457536496 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7fdc58072fe0 con 0xd20fc0 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.988+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> v2:172.21.15.104:6808/851587968 conn(0xd29130 0xe4f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.988+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xe4fb60 con 0xd29130 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.988+0000 7fdc6affd640 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fdc4803d1c0 0x7fdc4803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:52.989 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.988+0000 7fdc6affd640 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fdc4803d1c0 0x7fdc4803f6d0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:52.990 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.989+0000 7fdc6bfff640 1 --2- 172.21.15.59:0/457536496 >> v2:172.21.15.104:6808/851587968 conn(0xd29130 0xe4f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:52.993 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:52.992+0000 7fdc6bfff640 1 --2- 172.21.15.59:0/457536496 >> v2:172.21.15.104:6808/851587968 conn(0xd29130 0xe4f620 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc6bfff640 1 -- 172.21.15.59:0/457536496 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fdc6000c430 con 0xd29130 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 >> v2:172.21.15.104:6808/851587968 conn(0xd29130 msgr2=0xe4f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> v2:172.21.15.104:6808/851587968 conn(0xd29130 0xe4f620 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fdc4803d1c0 msgr2=0x7fdc4803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fdc4803d1c0 0x7fdc4803f6d0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 msgr2=0xe2f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xe2f780 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.007 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 shutdown_connections 2024-09-16T17:04:53.008 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> v2:172.21.15.104:6808/851587968 conn(0xd29130 0xe4f620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.008 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fdc4803d1c0 0x7fdc4803f6d0 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.008 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 --2- 172.21.15.59:0/457536496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd20fc0 0xe2f780 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.008 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 >> 172.21.15.59:0/457536496 conn(0xc4d770 msgr2=0xd24970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.008 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 shutdown_connections 2024-09-16T17:04:53.008 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.006+0000 7fdc77522ec0 1 -- 172.21.15.59:0/457536496 wait complete. 2024-09-16T17:04:53.009 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:53.009 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj5 /etc/passwd 2024-09-16T17:04:53.048 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.047+0000 7f48762f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.053+0000 7f48762f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.053+0000 7f48762f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.054+0000 7f48762f3ec0 1 Processor -- start 2024-09-16T17:04:53.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.054+0000 7f48762f3ec0 1 -- start start 2024-09-16T17:04:53.057 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f48762f3ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.057 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f48762f3ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x2157520 con 0x22859b0 2024-09-16T17:04:53.057 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486e63f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.057 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486e63f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35670/0 (socket says 172.21.15.59:35670) 2024-09-16T17:04:53.057 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486e63f640 1 -- 172.21.15.59:0/186423754 learned_addr learned my addr 172.21.15.59:0/186423754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.057 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486e63f640 1 -- 172.21.15.59:0/186423754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20f3e10 con 0x22859b0 2024-09-16T17:04:53.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486e63f640 1 --2- 172.21.15.59:0/186423754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21f6ad0 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301ac4389a265679 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486ce3c640 1 -- 172.21.15.59:0/186423754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f485802db60 con 0x22859b0 2024-09-16T17:04:53.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486ce3c640 1 -- 172.21.15.59:0/186423754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4858037370 con 0x22859b0 2024-09-16T17:04:53.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.056+0000 7f486ce3c640 1 -- 172.21.15.59:0/186423754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4858037610 con 0x22859b0 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 -- 172.21.15.59:0/186423754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 msgr2=0x21f6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/186423754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21f6ad0 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 -- 172.21.15.59:0/186423754 shutdown_connections 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/186423754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21f6ad0 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 -- 172.21.15.59:0/186423754 >> 172.21.15.59:0/186423754 conn(0x2117770 msgr2=0x21ef1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 -- 172.21.15.59:0/186423754 shutdown_connections 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.057+0000 7f48762f3ec0 1 -- 172.21.15.59:0/186423754 wait complete. 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.058+0000 7f48762f3ec0 1 Processor -- start 2024-09-16T17:04:53.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.058+0000 7f48762f3ec0 1 -- start start 2024-09-16T17:04:53.061 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.059+0000 7f48762f3ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21eba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.061 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.059+0000 7f48762f3ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x2155280 con 0x22859b0 2024-09-16T17:04:53.061 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f486e63f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21eba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.061 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f486e63f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21eba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35682/0 (socket says 172.21.15.59:35682) 2024-09-16T17:04:53.061 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f486e63f640 1 -- 172.21.15.59:0/2035480587 learned_addr learned my addr 172.21.15.59:0/2035480587 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.061 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f486e63f640 1 -- 172.21.15.59:0/2035480587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20e5920 con 0x22859b0 2024-09-16T17:04:53.062 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f486e63f640 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21eba30 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.062 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f48677fe640 1 -- 172.21.15.59:0/2035480587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4858037610 con 0x22859b0 2024-09-16T17:04:53.062 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f48677fe640 1 -- 172.21.15.59:0/2035480587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f485802da30 con 0x22859b0 2024-09-16T17:04:53.062 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20e5380 con 0x22859b0 2024-09-16T17:04:53.062 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f48677fe640 1 -- 172.21.15.59:0/2035480587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4858039580 con 0x22859b0 2024-09-16T17:04:53.062 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.060+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x21eb440 con 0x22859b0 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.061+0000 7f48677fe640 1 -- 172.21.15.59:0/2035480587 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4858039730 con 0x22859b0 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.061+0000 7f48677fe640 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f485403d1c0 0x7f485403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.062+0000 7f48677fe640 1 -- 172.21.15.59:0/2035480587 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7f4858032040 con 0x22859b0 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.062+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> v2:172.21.15.104:6808/851587968 conn(0x2286300 0x231ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.062+0000 7f486de3e640 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f485403d1c0 0x7f485403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.062+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x2276590 con 0x2286300 2024-09-16T17:04:53.063 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.062+0000 7f486de3e640 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f485403d1c0 0x7f485403f6d0 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.064 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.062+0000 7f486ee40640 1 --2- 172.21.15.59:0/2035480587 >> v2:172.21.15.104:6808/851587968 conn(0x2286300 0x231ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:53.065 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.065+0000 7f486ee40640 1 --2- 172.21.15.59:0/2035480587 >> v2:172.21.15.104:6808/851587968 conn(0x2286300 0x231ce20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f486ee40640 1 -- 172.21.15.59:0/2035480587 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f486000a430 con 0x2286300 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 >> v2:172.21.15.104:6808/851587968 conn(0x2286300 msgr2=0x231ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> v2:172.21.15.104:6808/851587968 conn(0x2286300 0x231ce20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f485403d1c0 msgr2=0x7f485403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f485403d1c0 0x7f485403f6d0 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 msgr2=0x21eba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21eba30 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.079 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 shutdown_connections 2024-09-16T17:04:53.080 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> v2:172.21.15.104:6808/851587968 conn(0x2286300 0x231ce20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.080 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f485403d1c0 0x7f485403f6d0 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.080 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 --2- 172.21.15.59:0/2035480587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x22859b0 0x21eba30 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.080 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 >> 172.21.15.59:0/2035480587 conn(0x2117770 msgr2=0x21f0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.080 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 shutdown_connections 2024-09-16T17:04:53.080 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.078+0000 7f48762f3ec0 1 -- 172.21.15.59:0/2035480587 wait complete. 2024-09-16T17:04:53.081 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:53.081 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj6 /etc/passwd 2024-09-16T17:04:53.119 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.118+0000 7f5907050ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.124 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.124+0000 7f5907050ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.125 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.124+0000 7f5907050ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.125 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.125+0000 7f5907050ec0 1 Processor -- start 2024-09-16T17:04:53.126 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.125+0000 7f5907050ec0 1 -- start start 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.126+0000 7f5907050ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x2052e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.126+0000 7f5907050ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1fba520 con 0x204fe30 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.126+0000 7f58ff19b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x2052e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.126+0000 7f58ff19b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x2052e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35704/0 (socket says 172.21.15.59:35704) 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.126+0000 7f58ff19b640 1 -- 172.21.15.59:0/169867789 learned_addr learned my addr 172.21.15.59:0/169867789 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.127+0000 7f58ff19b640 1 -- 172.21.15.59:0/169867789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f56e10 con 0x204fe30 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.127+0000 7f58ff19b640 1 --2- 172.21.15.59:0/169867789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x2052e90 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9be3240e4b48518 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.127+0000 7f58fd998640 1 -- 172.21.15.59:0/169867789 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58e8034040 con 0x204fe30 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.127+0000 7f58fd998640 1 -- 172.21.15.59:0/169867789 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58e802dbe0 con 0x204fe30 2024-09-16T17:04:53.128 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.127+0000 7f58fd998640 1 -- 172.21.15.59:0/169867789 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58e802da30 con 0x204fe30 2024-09-16T17:04:53.129 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 -- 172.21.15.59:0/169867789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 msgr2=0x2052e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.129 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 --2- 172.21.15.59:0/169867789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x2052e90 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.129 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 -- 172.21.15.59:0/169867789 shutdown_connections 2024-09-16T17:04:53.130 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 --2- 172.21.15.59:0/169867789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x2052e90 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.130 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 -- 172.21.15.59:0/169867789 >> 172.21.15.59:0/169867789 conn(0x1f7a770 msgr2=0x20e56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.130 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 -- 172.21.15.59:0/169867789 shutdown_connections 2024-09-16T17:04:53.130 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.128+0000 7f5907050ec0 1 -- 172.21.15.59:0/169867789 wait complete. 2024-09-16T17:04:53.130 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.129+0000 7f5907050ec0 1 Processor -- start 2024-09-16T17:04:53.130 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.129+0000 7f5907050ec0 1 -- start start 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.130+0000 7f5907050ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x217d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.130+0000 7f5907050ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1fb8280 con 0x204fe30 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58ff19b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x217d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58ff19b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x217d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35720/0 (socket says 172.21.15.59:35720) 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58ff19b640 1 -- 172.21.15.59:0/1368924236 learned_addr learned my addr 172.21.15.59:0/1368924236 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58ff19b640 1 -- 172.21.15.59:0/1368924236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f48920 con 0x204fe30 2024-09-16T17:04:53.132 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58ff19b640 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x217d7b0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.133 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58fc996640 1 -- 172.21.15.59:0/1368924236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58e8034040 con 0x204fe30 2024-09-16T17:04:53.133 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58fc996640 1 -- 172.21.15.59:0/1368924236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f58e8035040 con 0x204fe30 2024-09-16T17:04:53.133 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f48380 con 0x204fe30 2024-09-16T17:04:53.133 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f58fc996640 1 -- 172.21.15.59:0/1368924236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f58e802da30 con 0x204fe30 2024-09-16T17:04:53.133 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.131+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20d3f50 con 0x204fe30 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.132+0000 7f58fc996640 1 -- 172.21.15.59:0/1368924236 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f58e8003040 con 0x204fe30 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.133+0000 7f58fc996640 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f58e403d1c0 0x7f58e403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.133+0000 7f58fc996640 1 -- 172.21.15.59:0/1368924236 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7f58e8073180 con 0x204fe30 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.133+0000 7f58fe99a640 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f58e403d1c0 0x7f58e403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.133+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> v2:172.21.15.59:6811/1210870840 conn(0x20e8df0 0x20d2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.133+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 --> v2:172.21.15.59:6811/1210870840 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x20d5f60 con 0x20e8df0 2024-09-16T17:04:53.134 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.133+0000 7f58fe99a640 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f58e403d1c0 0x7f58e403f6d0 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.135 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.134+0000 7f58ff99c640 1 --2- 172.21.15.59:0/1368924236 >> v2:172.21.15.59:6811/1210870840 conn(0x20e8df0 0x20d2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:53.137 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.136+0000 7f58ff99c640 1 --2- 172.21.15.59:0/1368924236 >> v2:172.21.15.59:6811/1210870840 conn(0x20e8df0 0x20d2590 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f58ff99c640 1 -- 172.21.15.59:0/1368924236 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f58f000c430 con 0x20e8df0 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 >> v2:172.21.15.59:6811/1210870840 conn(0x20e8df0 msgr2=0x20d2590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> v2:172.21.15.59:6811/1210870840 conn(0x20e8df0 0x20d2590 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f58e403d1c0 msgr2=0x7f58e403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f58e403d1c0 0x7f58e403f6d0 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 msgr2=0x217d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.151 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x217d7b0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 shutdown_connections 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> v2:172.21.15.59:6811/1210870840 conn(0x20e8df0 0x20d2590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f58e403d1c0 0x7f58e403f6d0 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 --2- 172.21.15.59:0/1368924236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x204fe30 0x217d7b0 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.149+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 >> 172.21.15.59:0/1368924236 conn(0x1f7a770 msgr2=0x20e66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.150+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 shutdown_connections 2024-09-16T17:04:53.152 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.150+0000 7f5907050ec0 1 -- 172.21.15.59:0/1368924236 wait complete. 2024-09-16T17:04:53.153 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:53.153 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj7 /etc/passwd 2024-09-16T17:04:53.190 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.189+0000 7f7578576ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.196 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.195+0000 7f7578576ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.196 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.195+0000 7f7578576ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.197 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.196+0000 7f7578576ec0 1 Processor -- start 2024-09-16T17:04:53.197 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.196+0000 7f7578576ec0 1 -- start start 2024-09-16T17:04:53.199 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7578576ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x172e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.199 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7578576ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1697520 con 0x172ce30 2024-09-16T17:04:53.199 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7570f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x172e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.199 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7570f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x172e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35734/0 (socket says 172.21.15.59:35734) 2024-09-16T17:04:53.199 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7570f9b640 1 -- 172.21.15.59:0/26428299 learned_addr learned my addr 172.21.15.59:0/26428299 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7570f9b640 1 -- 172.21.15.59:0/26428299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1633e10 con 0x172ce30 2024-09-16T17:04:53.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f7570f9b640 1 --2- 172.21.15.59:0/26428299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x172e870 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3293f632d5c1faec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f756affd640 1 -- 172.21.15.59:0/26428299 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f755c00b580 con 0x172ce30 2024-09-16T17:04:53.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f756affd640 1 -- 172.21.15.59:0/26428299 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f755c00b6e0 con 0x172ce30 2024-09-16T17:04:53.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.198+0000 7f756affd640 1 -- 172.21.15.59:0/26428299 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f755c00b980 con 0x172ce30 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 -- 172.21.15.59:0/26428299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 msgr2=0x172e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 --2- 172.21.15.59:0/26428299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x172e870 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 -- 172.21.15.59:0/26428299 shutdown_connections 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 --2- 172.21.15.59:0/26428299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x172e870 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 -- 172.21.15.59:0/26428299 >> 172.21.15.59:0/26428299 conn(0x1657770 msgr2=0x1735370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 -- 172.21.15.59:0/26428299 shutdown_connections 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.199+0000 7f7578576ec0 1 -- 172.21.15.59:0/26428299 wait complete. 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.200+0000 7f7578576ec0 1 Processor -- start 2024-09-16T17:04:53.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.200+0000 7f7578576ec0 1 -- start start 2024-09-16T17:04:53.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7578576ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x17bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7578576ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1695280 con 0x172ce30 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7570f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x17bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7570f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x17bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35744/0 (socket says 172.21.15.59:35744) 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7570f9b640 1 -- 172.21.15.59:0/2260930189 learned_addr learned my addr 172.21.15.59:0/2260930189 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7570f9b640 1 -- 172.21.15.59:0/2260930189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1625920 con 0x172ce30 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7570f9b640 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x17bf0a0 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7569ffb640 1 -- 172.21.15.59:0/2260930189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f755c012990 con 0x172ce30 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7569ffb640 1 -- 172.21.15.59:0/2260930189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f755c005040 con 0x172ce30 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1625380 con 0x172ce30 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7569ffb640 1 -- 172.21.15.59:0/2260930189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f755c012c20 con 0x172ce30 2024-09-16T17:04:53.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.202+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x184d8a0 con 0x172ce30 2024-09-16T17:04:53.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.203+0000 7f7569ffb640 1 -- 172.21.15.59:0/2260930189 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f755c00d040 con 0x172ce30 2024-09-16T17:04:53.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.204+0000 7f7569ffb640 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f754c03d1c0 0x7f754c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.204+0000 7f7569ffb640 1 -- 172.21.15.59:0/2260930189 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7f755c00a040 con 0x172ce30 2024-09-16T17:04:53.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.204+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> v2:172.21.15.59:6800/3457013714 conn(0x17c5fc0 0x172a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.206 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.204+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x184e430 con 0x17c5fc0 2024-09-16T17:04:53.206 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.204+0000 7f7563fff640 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f754c03d1c0 0x7f754c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.206 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.205+0000 7f7563fff640 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f754c03d1c0 0x7f754c03f6d0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.206 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.205+0000 7f757179c640 1 --2- 172.21.15.59:0/2260930189 >> v2:172.21.15.59:6800/3457013714 conn(0x17c5fc0 0x172a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:53.209 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.208+0000 7f757179c640 1 --2- 172.21.15.59:0/2260930189 >> v2:172.21.15.59:6800/3457013714 conn(0x17c5fc0 0x172a5d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.223 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f757179c640 1 -- 172.21.15.59:0/2260930189 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f756400a430 con 0x17c5fc0 2024-09-16T17:04:53.223 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 >> v2:172.21.15.59:6800/3457013714 conn(0x17c5fc0 msgr2=0x172a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.223 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> v2:172.21.15.59:6800/3457013714 conn(0x17c5fc0 0x172a5d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.223 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f754c03d1c0 msgr2=0x7f754c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.223 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f754c03d1c0 0x7f754c03f6d0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 msgr2=0x17bf0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x17bf0a0 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 shutdown_connections 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> v2:172.21.15.59:6800/3457013714 conn(0x17c5fc0 0x172a5d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f754c03d1c0 0x7f754c03f6d0 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 --2- 172.21.15.59:0/2260930189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x172ce30 0x17bf0a0 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 >> 172.21.15.59:0/2260930189 conn(0x1657770 msgr2=0x1735370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 shutdown_connections 2024-09-16T17:04:53.224 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.222+0000 7f7578576ec0 1 -- 172.21.15.59:0/2260930189 wait complete. 2024-09-16T17:04:53.225 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:53.225 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj8 /etc/passwd 2024-09-16T17:04:53.263 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.262+0000 7f2c4bf0bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.269 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.268+0000 7f2c4bf0bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.269 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.268+0000 7f2c4bf0bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.270 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.269+0000 7f2c4bf0bec0 1 Processor -- start 2024-09-16T17:04:53.270 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.269+0000 7f2c4bf0bec0 1 -- start start 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.270+0000 7f2c4bf0bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1e91590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.270+0000 7f2c4bf0bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1cdd520 con 0x1d79300 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c4483f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1e91590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c4483f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1e91590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35766/0 (socket says 172.21.15.59:35766) 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c4483f640 1 -- 172.21.15.59:0/3181556670 learned_addr learned my addr 172.21.15.59:0/3181556670 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c4483f640 1 -- 172.21.15.59:0/3181556670 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c79e10 con 0x1d79300 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c4483f640 1 --2- 172.21.15.59:0/3181556670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1e91590 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bbec9dc06a0226 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.272 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c3effd640 1 -- 172.21.15.59:0/3181556670 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c3002dc20 con 0x1d79300 2024-09-16T17:04:53.273 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c3effd640 1 -- 172.21.15.59:0/3181556670 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c30037370 con 0x1d79300 2024-09-16T17:04:53.273 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.271+0000 7f2c3effd640 1 -- 172.21.15.59:0/3181556670 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c30037610 con 0x1d79300 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/3181556670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 msgr2=0x1e91590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/3181556670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1e91590 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/3181556670 shutdown_connections 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/3181556670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1e91590 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/3181556670 >> 172.21.15.59:0/3181556670 conn(0x1c9d770 msgr2=0x1d7b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/3181556670 shutdown_connections 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.272+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/3181556670 wait complete. 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.273+0000 7f2c4bf0bec0 1 Processor -- start 2024-09-16T17:04:53.274 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.273+0000 7f2c4bf0bec0 1 -- start start 2024-09-16T17:04:53.276 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.274+0000 7f2c4bf0bec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1d71550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.276 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.274+0000 7f2c4bf0bec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1cdb280 con 0x1d79300 2024-09-16T17:04:53.276 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4483f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1d71550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.276 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4483f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1d71550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35782/0 (socket says 172.21.15.59:35782) 2024-09-16T17:04:53.276 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4483f640 1 -- 172.21.15.59:0/822544597 learned_addr learned my addr 172.21.15.59:0/822544597 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.276 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4483f640 1 -- 172.21.15.59:0/822544597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c6b920 con 0x1d79300 2024-09-16T17:04:53.277 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4483f640 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1d71550 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.277 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c3dffb640 1 -- 172.21.15.59:0/822544597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c3003e040 con 0x1d79300 2024-09-16T17:04:53.277 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c3dffb640 1 -- 172.21.15.59:0/822544597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c3002daf0 con 0x1d79300 2024-09-16T17:04:53.277 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c6b380 con 0x1d79300 2024-09-16T17:04:53.277 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c3dffb640 1 -- 172.21.15.59:0/822544597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c30037e20 con 0x1d79300 2024-09-16T17:04:53.277 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.275+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e94860 con 0x1d79300 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.276+0000 7f2c3dffb640 1 -- 172.21.15.59:0/822544597 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2c30041040 con 0x1d79300 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c3dffb640 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2c2c03d1c0 0x7f2c2c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c3dffb640 1 -- 172.21.15.59:0/822544597 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7f2c30032040 con 0x1d79300 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> v2:172.21.15.59:6800/3457013714 conn(0x1e0ba60 0x1e07f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x1d77280 con 0x1e0ba60 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c3ffff640 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2c2c03d1c0 0x7f2c2c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.278 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c3ffff640 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2c2c03d1c0 0x7f2c2c03f6d0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.279 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.277+0000 7f2c45040640 1 --2- 172.21.15.59:0/822544597 >> v2:172.21.15.59:6800/3457013714 conn(0x1e0ba60 0x1e07f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:53.281 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.280+0000 7f2c45040640 1 --2- 172.21.15.59:0/822544597 >> v2:172.21.15.59:6800/3457013714 conn(0x1e0ba60 0x1e07f00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.294+0000 7f2c45040640 1 -- 172.21.15.59:0/822544597 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2c3800a430 con 0x1e0ba60 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.294+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 >> v2:172.21.15.59:6800/3457013714 conn(0x1e0ba60 msgr2=0x1e07f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.294+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> v2:172.21.15.59:6800/3457013714 conn(0x1e0ba60 0x1e07f00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2c2c03d1c0 msgr2=0x7f2c2c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2c2c03d1c0 0x7f2c2c03f6d0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 msgr2=0x1d71550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1d71550 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 shutdown_connections 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> v2:172.21.15.59:6800/3457013714 conn(0x1e0ba60 0x1e07f00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.296 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2c2c03d1c0 0x7f2c2c03f6d0 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.297 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 --2- 172.21.15.59:0/822544597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1d79300 0x1d71550 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.297 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 >> 172.21.15.59:0/822544597 conn(0x1c9d770 msgr2=0x1e91590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.297 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 shutdown_connections 2024-09-16T17:04:53.297 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.295+0000 7f2c4bf0bec0 1 -- 172.21.15.59:0/822544597 wait complete. 2024-09-16T17:04:53.298 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:53.298 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj9 /etc/passwd 2024-09-16T17:04:53.335 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.335+0000 7f2bfcc31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.341 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.340+0000 7f2bfcc31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.341 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.340+0000 7f2bfcc31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.342 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.341+0000 7f2bfcc31ec0 1 Processor -- start 2024-09-16T17:04:53.342 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.341+0000 7f2bfcc31ec0 1 -- start start 2024-09-16T17:04:53.344 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bfcc31ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x19108f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.344 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bfcc31ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x175a520 con 0x18889b0 2024-09-16T17:04:53.344 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bf4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x19108f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bf4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x19108f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35812/0 (socket says 172.21.15.59:35812) 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bf4d9b640 1 -- 172.21.15.59:0/1543242047 learned_addr learned my addr 172.21.15.59:0/1543242047 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bf4d9b640 1 -- 172.21.15.59:0/1543242047 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16f6e10 con 0x18889b0 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2bf4d9b640 1 --2- 172.21.15.59:0/1543242047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x19108f0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4cfdc1321e2fda server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.343+0000 7f2beeffd640 1 -- 172.21.15.59:0/1543242047 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2be000b500 con 0x18889b0 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2beeffd640 1 -- 172.21.15.59:0/1543242047 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2be000b660 con 0x18889b0 2024-09-16T17:04:53.345 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2beeffd640 1 -- 172.21.15.59:0/1543242047 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2be000b900 con 0x18889b0 2024-09-16T17:04:53.350 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/1543242047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 msgr2=0x19108f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.350 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/1543242047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x19108f0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.350 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/1543242047 shutdown_connections 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/1543242047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x19108f0 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/1543242047 >> 172.21.15.59:0/1543242047 conn(0x171a770 msgr2=0x17f32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/1543242047 shutdown_connections 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.344+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/1543242047 wait complete. 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.345+0000 7f2bfcc31ec0 1 Processor -- start 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.345+0000 7f2bfcc31ec0 1 -- start start 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bfcc31ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x191d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bfcc31ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1758280 con 0x18889b0 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bf4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x191d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bf4d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x191d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35820/0 (socket says 172.21.15.59:35820) 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bf4d9b640 1 -- 172.21.15.59:0/3419447643 learned_addr learned my addr 172.21.15.59:0/3419447643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bf4d9b640 1 -- 172.21.15.59:0/3419447643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16e8920 con 0x18889b0 2024-09-16T17:04:53.351 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bf4d9b640 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x191d810 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.347+0000 7f2bedffb640 1 -- 172.21.15.59:0/3419447643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2be00110b0 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.348+0000 7f2bedffb640 1 -- 172.21.15.59:0/3419447643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2be0011210 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.348+0000 7f2bedffb640 1 -- 172.21.15.59:0/3419447643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2be0011b80 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.348+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x16e8380 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.348+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1888800 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.349+0000 7f2bedffb640 1 -- 172.21.15.59:0/3419447643 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2be0011d30 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.349+0000 7f2bedffb640 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2bd003d1c0 0x7f2bd003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.349+0000 7f2bedffb640 1 -- 172.21.15.59:0/3419447643 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7f2be00503d0 con 0x18889b0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.349+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> v2:172.21.15.104:6808/851587968 conn(0x18894d0 0x1887510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.349+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 --> v2:172.21.15.104:6808/851587968 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x1877a80 con 0x18894d0 2024-09-16T17:04:53.352 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.349+0000 7f2be7fff640 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2bd003d1c0 0x7f2bd003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.353 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.350+0000 7f2be7fff640 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2bd003d1c0 0x7f2bd003f6d0 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.353 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.350+0000 7f2bf559c640 1 --2- 172.21.15.59:0/3419447643 >> v2:172.21.15.104:6808/851587968 conn(0x18894d0 0x1887510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:53.354 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.353+0000 7f2bf559c640 1 --2- 172.21.15.59:0/3419447643 >> v2:172.21.15.104:6808/851587968 conn(0x18894d0 0x1887510 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bf559c640 1 -- 172.21.15.59:0/3419447643 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v716'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2be800a430 con 0x18894d0 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 >> v2:172.21.15.104:6808/851587968 conn(0x18894d0 msgr2=0x1887510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> v2:172.21.15.104:6808/851587968 conn(0x18894d0 0x1887510 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2bd003d1c0 msgr2=0x7f2bd003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2bd003d1c0 0x7f2bd003f6d0 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 msgr2=0x191d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x191d810 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 shutdown_connections 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> v2:172.21.15.104:6808/851587968 conn(0x18894d0 0x1887510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2bd003d1c0 0x7f2bd003f6d0 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.369 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 --2- 172.21.15.59:0/3419447643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x18889b0 0x191d810 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.370 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 >> 172.21.15.59:0/3419447643 conn(0x171a770 msgr2=0x17f32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.370 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 shutdown_connections 2024-09-16T17:04:53.370 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.368+0000 7f2bfcc31ec0 1 -- 172.21.15.59:0/3419447643 wait complete. 2024-09-16T17:04:53.370 INFO:tasks.workunit.client.0.smithi059.stderr:+ for f in `seq 1 10` 2024-09-16T17:04:53.370 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 put obj10 /etc/passwd 2024-09-16T17:04:53.408 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.408+0000 7fbdc3679ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.414 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.413+0000 7fbdc3679ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.414 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.414+0000 7fbdc3679ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:53.415 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.414+0000 7fbdc3679ec0 1 Processor -- start 2024-09-16T17:04:53.415 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.414+0000 7fbdc3679ec0 1 -- start start 2024-09-16T17:04:53.417 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdc3679ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x1f7ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.417 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdc3679ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1efd520 con 0x1f90fc0 2024-09-16T17:04:53.417 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdbb79b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x1f7ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdbb79b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x1f7ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35846/0 (socket says 172.21.15.59:35846) 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdbb79b640 1 -- 172.21.15.59:0/1956715272 learned_addr learned my addr 172.21.15.59:0/1956715272 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdbb79b640 1 -- 172.21.15.59:0/1956715272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e99e10 con 0x1f90fc0 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.416+0000 7fbdbb79b640 1 --2- 172.21.15.59:0/1956715272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x1f7ed80 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa5a171e7807041 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdb9f98640 1 -- 172.21.15.59:0/1956715272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbda400c5e0 con 0x1f90fc0 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdb9f98640 1 -- 172.21.15.59:0/1956715272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbda400c740 con 0x1f90fc0 2024-09-16T17:04:53.418 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdb9f98640 1 -- 172.21.15.59:0/1956715272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbda400c9e0 con 0x1f90fc0 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/1956715272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 msgr2=0x1f7ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/1956715272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x1f7ed80 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/1956715272 shutdown_connections 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/1956715272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x1f7ed80 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/1956715272 >> 172.21.15.59:0/1956715272 conn(0x1ebd770 msgr2=0x1f92700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/1956715272 shutdown_connections 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.417+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/1956715272 wait complete. 2024-09-16T17:04:53.419 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.418+0000 7fbdc3679ec0 1 Processor -- start 2024-09-16T17:04:53.420 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.418+0000 7fbdc3679ec0 1 -- start start 2024-09-16T17:04:53.421 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdc3679ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x20a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.421 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdc3679ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x1efb280 con 0x1f90fc0 2024-09-16T17:04:53.421 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdbb79b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x20a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdbb79b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x20a3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35862/0 (socket says 172.21.15.59:35862) 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdbb79b640 1 -- 172.21.15.59:0/2741662550 learned_addr learned my addr 172.21.15.59:0/2741662550 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdbb79b640 1 -- 172.21.15.59:0/2741662550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e8b920 con 0x1f90fc0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdbb79b640 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x20a3280 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdb8f96640 1 -- 172.21.15.59:0/2741662550 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbda4013a70 con 0x1f90fc0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdb8f96640 1 -- 172.21.15.59:0/2741662550 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbda4013bd0 con 0x1f90fc0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e8b380 con 0x1f90fc0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdb8f96640 1 -- 172.21.15.59:0/2741662550 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbda4013e70 con 0x1f90fc0 2024-09-16T17:04:53.422 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.420+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20b3920 con 0x1f90fc0 2024-09-16T17:04:53.423 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.421+0000 7fbdb8f96640 1 -- 172.21.15.59:0/2741662550 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbda4010400 con 0x1f90fc0 2024-09-16T17:04:53.423 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.422+0000 7fbdb8f96640 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbda003d1c0 0x7fbda003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.423 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.422+0000 7fbdb8f96640 1 -- 172.21.15.59:0/2741662550 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(716..716 src has 403..716) ==== 4207+0+0 (crc 0 0 0) 0x7fbda4008040 con 0x1f90fc0 2024-09-16T17:04:53.423 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.422+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> v2:172.21.15.59:6800/3457013714 conn(0x1f99300 0x20c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:53.424 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.422+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 --> v2:172.21.15.59:6800/3457013714 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x20c0c40 con 0x1f99300 2024-09-16T17:04:53.424 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.422+0000 7fbdbaf9a640 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbda003d1c0 0x7fbda003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:53.424 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.423+0000 7fbdbaf9a640 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbda003d1c0 0x7fbda003f6d0 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.424 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.423+0000 7fbdbbf9c640 1 --2- 172.21.15.59:0/2741662550 >> v2:172.21.15.59:6800/3457013714 conn(0x1f99300 0x20c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:53.427 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.426+0000 7fbdbbf9c640 1 --2- 172.21.15.59:0/2741662550 >> v2:172.21.15.59:6800/3457013714 conn(0x1f99300 0x20c0700 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdbbf9c640 1 -- 172.21.15.59:0/2741662550 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbdac00a430 con 0x1f99300 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 >> v2:172.21.15.59:6800/3457013714 conn(0x1f99300 msgr2=0x20c0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> v2:172.21.15.59:6800/3457013714 conn(0x1f99300 0x20c0700 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbda003d1c0 msgr2=0x7fbda003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbda003d1c0 0x7fbda003f6d0 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 msgr2=0x20a3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x20a3280 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 shutdown_connections 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> v2:172.21.15.59:6800/3457013714 conn(0x1f99300 0x20c0700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.441 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbda003d1c0 0x7fbda003f6d0 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.442 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 --2- 172.21.15.59:0/2741662550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1f90fc0 0x20a3280 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:53.442 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.439+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 >> 172.21.15.59:0/2741662550 conn(0x1ebd770 msgr2=0x1f9cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:53.442 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.440+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 shutdown_connections 2024-09-16T17:04:53.442 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:04:53.440+0000 7fbdc3679ec0 1 -- 172.21.15.59:0/2741662550 wait complete. 2024-09-16T17:04:53.443 INFO:tasks.workunit.client.0.smithi059.stderr:+ sleep 30 2024-09-16T17:05:23.444 INFO:tasks.workunit.client.0.smithi059.stderr:+ rados -p 91fcba37-be76-447c-b31c-498d24e0adc8 put threemore /etc/passwd 2024-09-16T17:05:23.490 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.489+0000 7f28df776ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:23.497 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.496+0000 7f28df776ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:23.497 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.496+0000 7f28df776ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:23.497 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.497+0000 7f28df776ec0 1 Processor -- start 2024-09-16T17:05:23.497 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.497+0000 7f28df776ec0 1 -- start start 2024-09-16T17:05:23.499 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.498+0000 7f28df776ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x777f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.499 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.498+0000 7f28df776ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5be520 con 0x65a300 2024-09-16T17:05:23.499 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.498+0000 7f28d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x777f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:23.499 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.498+0000 7f28d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x777f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45676/0 (socket says 172.21.15.59:45676) 2024-09-16T17:05:23.499 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.498+0000 7f28d3fff640 1 -- 172.21.15.59:0/781780063 learned_addr learned my addr 172.21.15.59:0/781780063 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:23.500 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.499+0000 7f28d3fff640 1 -- 172.21.15.59:0/781780063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae10 con 0x65a300 2024-09-16T17:05:23.500 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.499+0000 7f28d3fff640 1 --2- 172.21.15.59:0/781780063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x777f60 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fafff6c18b22a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.500 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.499+0000 7f28d27fc640 1 -- 172.21.15.59:0/781780063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f28c400d8c0 con 0x65a300 2024-09-16T17:05:23.500 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.499+0000 7f28d27fc640 1 -- 172.21.15.59:0/781780063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f28c400da20 con 0x65a300 2024-09-16T17:05:23.500 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.499+0000 7f28d27fc640 1 -- 172.21.15.59:0/781780063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f28c400dcc0 con 0x65a300 2024-09-16T17:05:23.501 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 -- 172.21.15.59:0/781780063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 msgr2=0x777f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:23.501 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 --2- 172.21.15.59:0/781780063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x777f60 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.501 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 -- 172.21.15.59:0/781780063 shutdown_connections 2024-09-16T17:05:23.501 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 --2- 172.21.15.59:0/781780063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x777f60 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.501 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 -- 172.21.15.59:0/781780063 >> 172.21.15.59:0/781780063 conn(0x57e770 msgr2=0x65d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:23.502 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 -- 172.21.15.59:0/781780063 shutdown_connections 2024-09-16T17:05:23.502 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.500+0000 7f28df776ec0 1 -- 172.21.15.59:0/781780063 wait complete. 2024-09-16T17:05:23.502 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.501+0000 7f28df776ec0 1 Processor -- start 2024-09-16T17:05:23.502 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.501+0000 7f28df776ec0 1 -- start start 2024-09-16T17:05:23.504 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.502+0000 7f28df776ec0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x77f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.504 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.502+0000 7f28df776ec0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5bc280 con 0x65a300 2024-09-16T17:05:23.504 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x77f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:23.504 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x77f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45680/0 (socket says 172.21.15.59:45680) 2024-09-16T17:05:23.504 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d3fff640 1 -- 172.21.15.59:0/1263408606 learned_addr learned my addr 172.21.15.59:0/1263408606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d3fff640 1 -- 172.21.15.59:0/1263408606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x54c920 con 0x65a300 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d3fff640 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x77f350 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d17fa640 1 -- 172.21.15.59:0/1263408606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f28c4001580 con 0x65a300 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d17fa640 1 -- 172.21.15.59:0/1263408606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f28c4013040 con 0x65a300 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28d17fa640 1 -- 172.21.15.59:0/1263408606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f28c400d8c0 con 0x65a300 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x54c380 con 0x65a300 2024-09-16T17:05:23.505 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.503+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x77f120 con 0x65a300 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28d17fa640 1 -- 172.21.15.59:0/1263408606 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f28c40083d0 con 0x65a300 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28d17fa640 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f28b403d1c0 0x7f28b403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28d17fa640 1 -- 172.21.15.59:0/1263408606 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(718..718 src has 403..718) ==== 4207+0+0 (crc 0 0 0) 0x7f28c40528c0 con 0x65a300 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28d17fa640 1 -- 172.21.15.59:0/1263408606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7f28b4043c50 con 0x65a300 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> v2:172.21.15.104:6803/2992308739 conn(0x65ae20 0x771720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 --> v2:172.21.15.104:6803/2992308739 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x773510 con 0x65ae20 2024-09-16T17:05:23.506 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.505+0000 7f28d37fe640 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f28b403d1c0 0x7f28b403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:23.507 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.506+0000 7f28d37fe640 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f28b403d1c0 0x7f28b403f6d0 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.507 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.506+0000 7f28d899c640 1 --2- 172.21.15.59:0/1263408606 >> v2:172.21.15.104:6803/2992308739 conn(0x65ae20 0x771720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:23.512 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.511+0000 7f28d899c640 1 --2- 172.21.15.59:0/1263408606 >> v2:172.21.15.104:6803/2992308739 conn(0x65ae20 0x771720 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28d899c640 1 -- 172.21.15.59:0/1263408606 <== osd.2 v2:172.21.15.104:6803/2992308739 1 ==== osd_op_reply(1 threemore [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f28cc00a430 con 0x65ae20 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 >> v2:172.21.15.104:6803/2992308739 conn(0x65ae20 msgr2=0x771720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> v2:172.21.15.104:6803/2992308739 conn(0x65ae20 0x771720 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f28b403d1c0 msgr2=0x7f28b403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f28b403d1c0 0x7f28b403f6d0 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 msgr2=0x77f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x77f350 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 shutdown_connections 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> v2:172.21.15.104:6803/2992308739 conn(0x65ae20 0x771720 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f28b403d1c0 0x7f28b403f6d0 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.531 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.529+0000 7f28df776ec0 1 --2- 172.21.15.59:0/1263408606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x65a300 0x77f350 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.532 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.530+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 >> 172.21.15.59:0/1263408606 conn(0x57e770 msgr2=0x65ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:23.532 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.530+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 shutdown_connections 2024-09-16T17:05:23.532 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.530+0000 7f28df776ec0 1 -- 172.21.15.59:0/1263408606 wait complete. 2024-09-16T17:05:23.533 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_bytes 0 2024-09-16T17:05:23.634 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.624+0000 7f41cd951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:23.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.634+0000 7f41cd951640 1 Processor -- start 2024-09-16T17:05:23.635 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.634+0000 7f41cd951640 1 -- start start 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41cd951640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c81393c0 0x7f41c813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41cd951640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c806dd50 con 0x7f41c806e6e0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41cd951640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f41c806f200 con 0x7f41c81393c0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41c67fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c81393c0 0x7f41c813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41c67fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c81393c0 0x7f41c813b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45692/0 (socket says 172.21.15.59:45692) 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41c6ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f41c806e6e0 0x7f41c806eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45066/0 (socket says 172.21.15.59:45066) 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41c67fc640 1 -- 172.21.15.59:0/1006513012 learned_addr learned my addr 172.21.15.59:0/1006513012 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41c67fc640 1 -- 172.21.15.59:0/1006513012 >> v1:172.21.15.59:6789/0 conn(0x7f41c806e6e0 legacy=0x7f41c806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.636+0000 7f41c67fc640 1 -- 172.21.15.59:0/1006513012 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c806f590 con 0x7f41c81393c0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41c67fc640 1 --2- 172.21.15.59:0/1006513012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c81393c0 0x7f41c813b7e0 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3789fd742a969d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41c5ffb640 1 -- 172.21.15.59:0/1006513012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f41bc009e40 con 0x7f41c81393c0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41c5ffb640 1 -- 172.21.15.59:0/1006513012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f41bc00e230 con 0x7f41c81393c0 2024-09-16T17:05:23.638 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41c5ffb640 1 -- 172.21.15.59:0/1006513012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f41bc00e4d0 con 0x7f41c81393c0 2024-09-16T17:05:23.639 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41cd951640 1 -- 172.21.15.59:0/1006513012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c81393c0 msgr2=0x7f41c813b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:23.639 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41cd951640 1 --2- 172.21.15.59:0/1006513012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c81393c0 0x7f41c813b7e0 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.639 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41cd951640 1 -- 172.21.15.59:0/1006513012 shutdown_connections 2024-09-16T17:05:23.639 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.637+0000 7f41cd951640 1 --2- 172.21.15.59:0/1006513012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c81393c0 0x7f41c813b7e0 unknown :-1 s=CLOSED pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:23.639 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.638+0000 7f41cd951640 1 -- 172.21.15.59:0/1006513012 >> 172.21.15.59:0/1006513012 conn(0x7f41c80a31b0 msgr2=0x7f41c80a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:23.640 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.638+0000 7f41cd951640 1 -- 172.21.15.59:0/1006513012 shutdown_connections 2024-09-16T17:05:23.640 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.638+0000 7f41cd951640 1 -- 172.21.15.59:0/1006513012 wait complete. 2024-09-16T17:05:23.640 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.638+0000 7f41cd951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:23.640 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.640+0000 7f41cd951640 1 Processor -- start 2024-09-16T17:05:23.640 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.640+0000 7f41cd951640 1 -- start start 2024-09-16T17:05:23.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.641+0000 7f41cd951640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 0x7f41c8125f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.641+0000 7f41cd951640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f41c8125cf0 con 0x7f41c806e6e0 2024-09-16T17:05:23.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.641+0000 7f41c6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 0x7f41c8125f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:23.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.641+0000 7f41c6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 0x7f41c8125f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45696/0 (socket says 172.21.15.59:45696) 2024-09-16T17:05:23.642 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.641+0000 7f41c6ffd640 1 -- 172.21.15.59:0/2066312895 learned_addr learned my addr 172.21.15.59:0/2066312895 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:23.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41c6ffd640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c8129570 con 0x7f41c806e6e0 2024-09-16T17:05:23.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41c6ffd640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 0x7f41c8125f10 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f41b80059a0 con 0x7f41c806e6e0 2024-09-16T17:05:23.643 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f41b8005b00 con 0x7f41c806e6e0 2024-09-16T17:05:23.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c8127e30 con 0x7f41c806e6e0 2024-09-16T17:05:23.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f41b8005da0 con 0x7f41c806e6e0 2024-09-16T17:05:23.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.642+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c8125610 con 0x7f41c806e6e0 2024-09-16T17:05:23.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.643+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f41b80070b0 con 0x7f41c806e6e0 2024-09-16T17:05:23.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.643+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c806fe30 con 0x7f41c806e6e0 2024-09-16T17:05:23.644 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.643+0000 7f41affff640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f41b403e930 0x7f41b4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:23.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.644+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(718..718 src has 403..718) ==== 4207+0+0 (crc 0 0 0) 0x7f41b804fd10 con 0x7f41c806e6e0 2024-09-16T17:05:23.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.644+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7f41b40453c0 con 0x7f41c806e6e0 2024-09-16T17:05:23.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.644+0000 7f41c67fc640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f41b403e930 0x7f41b4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:23.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.644+0000 7f41c67fc640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f41b403e930 0x7f41b4040e40 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:23.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.649+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f41b800f420 con 0x7f41c806e6e0 2024-09-16T17:05:23.854 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.853+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"} v 0) -- 0x7f41c806a450 con 0x7f41c806e6e0 2024-09-16T17:05:23.905 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.904+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v719) ==== 217+0+0 (crc 0 0 0) 0x7f41b800d150 con 0x7f41c806e6e0 2024-09-16T17:05:23.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.905+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(719..719 src has 403..719) ==== 628+0+0 (crc 0 0 0) 0x7f41b800dbe0 con 0x7f41c806e6e0 2024-09-16T17:05:23.906 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:23.905+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7f41b4046440 con 0x7f41c806e6e0 2024-09-16T17:05:24.039 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.038+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"} v 0) -- 0x7f41c8128a20 con 0x7f41c806e6e0 2024-09-16T17:05:24.919 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.918+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v720) ==== 217+0+0 (crc 0 0 0) 0x7f41b800d840 con 0x7f41c806e6e0 2024-09-16T17:05:24.919 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_bytes = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f41b403e930 msgr2=0x7f41b4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f41b403e930 0x7f41b4040e40 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 msgr2=0x7f41c8125f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41affff640 1 -- 172.21.15.59:0/2066312895 <== mon.0 v2:172.21.15.59:3300/0 10 ==== osd_map(720..720 src has 403..720) ==== 628+0+0 (crc 0 0 0) 0x7f41b800ac40 con 0x7f41c806e6e0 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 0x7f41c8125f10 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 shutdown_connections 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f41b403e930 0x7f41b4040e40 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 --2- 172.21.15.59:0/2066312895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c806e6e0 0x7f41c8125f10 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 >> 172.21.15.59:0/2066312895 conn(0x7f41c80a31b0 msgr2=0x7f41c809ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:24.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 shutdown_connections 2024-09-16T17:05:24.923 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:24.921+0000 7f41cd951640 1 -- 172.21.15.59:0/2066312895 wait complete. 2024-09-16T17:05:24.939 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool set-quota 91fcba37-be76-447c-b31c-498d24e0adc8 max_objects 0 2024-09-16T17:05:25.049 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.039+0000 7fcda7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:25.050 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.049+0000 7fcda7b91640 1 Processor -- start 2024-09-16T17:05:25.050 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.049+0000 7fcda7b91640 1 -- start start 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda7b91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcda00a0290 0x7fcda00a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda7b91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda00a12e0 con 0x7fcda00a0be0 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda7b91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcda0071790 con 0x7fcda00a0290 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda592d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcda00a0290 0x7fcda00a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda512c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcda00a0be0 0x7fcda0133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45068/0 (socket says 172.21.15.59:45068) 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda592d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcda00a0290 0x7fcda00a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45708/0 (socket says 172.21.15.59:45708) 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda512c640 1 -- 172.21.15.59:0/3527670410 learned_addr learned my addr 172.21.15.59:0/3527670410 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda592d640 1 -- 172.21.15.59:0/3527670410 >> v1:172.21.15.59:6789/0 conn(0x7fcda00a0be0 legacy=0x7fcda0133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.051+0000 7fcda592d640 1 -- 172.21.15.59:0/3527670410 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda00a1c80 con 0x7fcda00a0290 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.052+0000 7fcda592d640 1 --2- 172.21.15.59:0/3527670410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda00a06a0 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566ad92b28056851 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:25.053 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.052+0000 7fcda492b640 1 -- 172.21.15.59:0/3527670410 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd9c009d90 con 0x7fcda00a0290 2024-09-16T17:05:25.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.052+0000 7fcda492b640 1 -- 172.21.15.59:0/3527670410 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcd9c00e230 con 0x7fcda00a0290 2024-09-16T17:05:25.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.052+0000 7fcda492b640 1 -- 172.21.15.59:0/3527670410 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd9c00e4d0 con 0x7fcda00a0290 2024-09-16T17:05:25.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.052+0000 7fcda7b91640 1 -- 172.21.15.59:0/3527670410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 msgr2=0x7fcda00a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:25.054 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.052+0000 7fcda7b91640 1 --2- 172.21.15.59:0/3527670410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda00a06a0 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.053+0000 7fcda7b91640 1 -- 172.21.15.59:0/3527670410 shutdown_connections 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.053+0000 7fcda7b91640 1 --2- 172.21.15.59:0/3527670410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda00a06a0 unknown :-1 s=CLOSED pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.053+0000 7fcda7b91640 1 -- 172.21.15.59:0/3527670410 >> 172.21.15.59:0/3527670410 conn(0x7fcda009d9e0 msgr2=0x7fcda009ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.053+0000 7fcda7b91640 1 -- 172.21.15.59:0/3527670410 shutdown_connections 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.053+0000 7fcda7b91640 1 -- 172.21.15.59:0/3527670410 wait complete. 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.053+0000 7fcda7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.055+0000 7fcda7b91640 1 Processor -- start 2024-09-16T17:05:25.055 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.055+0000 7fcda7b91640 1 -- start start 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.056+0000 7fcda7b91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda0123c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.056+0000 7fcda7b91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcda0134e70 con 0x7fcda00a0290 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.056+0000 7fcda592d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda0123c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.056+0000 7fcda592d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda0123c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45716/0 (socket says 172.21.15.59:45716) 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.056+0000 7fcda592d640 1 -- 172.21.15.59:0/407767947 learned_addr learned my addr 172.21.15.59:0/407767947 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcda592d640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda0124f60 con 0x7fcda00a0290 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcda592d640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda0123c20 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd9c014620 con 0x7fcda00a0290 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcd9c014780 con 0x7fcda00a0290 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda00a2a60 con 0x7fcda00a0290 2024-09-16T17:05:25.058 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd9c014a20 con 0x7fcda00a0290 2024-09-16T17:05:25.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.057+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda01256a0 con 0x7fcda00a0290 2024-09-16T17:05:25.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.058+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcd9c014bd0 con 0x7fcda00a0290 2024-09-16T17:05:25.059 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.058+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda0125ed0 con 0x7fcda00a0290 2024-09-16T17:05:25.060 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.058+0000 7fcd967fc640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcd8403e930 0x7fcd84040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:25.060 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.058+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(720..720 src has 403..720) ==== 4207+0+0 (crc 0 0 0) 0x7fcd9c019040 con 0x7fcda00a0290 2024-09-16T17:05:25.060 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.058+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7fcd84045360 con 0x7fcda00a0290 2024-09-16T17:05:25.060 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.059+0000 7fcda512c640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcd8403e930 0x7fcd84040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:25.060 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.059+0000 7fcda512c640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcd8403e930 0x7fcd84040e40 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:25.064 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.063+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fcd9c012580 con 0x7fcda00a0290 2024-09-16T17:05:25.251 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.250+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"} v 0) -- 0x7fcda00a20b0 con 0x7fcda00a0290 2024-09-16T17:05:25.920 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.919+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v721) ==== 221+0+0 (crc 0 0 0) 0x7fcd9c008f20 con 0x7fcda00a0290 2024-09-16T17:05:25.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.921+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(721..721 src has 403..721) ==== 628+0+0 (crc 0 0 0) 0x7fcd9c018710 con 0x7fcda00a0290 2024-09-16T17:05:25.922 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:25.922+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7fcd84046160 con 0x7fcda00a0290 2024-09-16T17:05:26.050 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.049+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"} v 0) -- 0x7fcda00008d0 con 0x7fcda00a0290 2024-09-16T17:05:26.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.644+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 v722) ==== 221+0+0 (crc 0 0 0) 0x7fcd9c018190 con 0x7fcda00a0290 2024-09-16T17:05:26.645 INFO:tasks.workunit.client.0.smithi059.stderr:set-quota max_objects = 0 for pool 91fcba37-be76-447c-b31c-498d24e0adc8 2024-09-16T17:05:26.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.644+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 <== mon.0 v2:172.21.15.59:3300/0 10 ==== osd_map(722..722 src has 403..722) ==== 628+0+0 (crc 0 0 0) 0x7fcd9c0513f0 con 0x7fcda00a0290 2024-09-16T17:05:26.645 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.644+0000 7fcd967fc640 1 -- 172.21.15.59:0/407767947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7fcd840464e0 con 0x7fcda00a0290 2024-09-16T17:05:26.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.648+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcd8403e930 msgr2=0x7fcd84040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:26.649 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.648+0000 7fcda7b91640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcd8403e930 0x7fcd84040e40 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.648+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 msgr2=0x7fcda0123c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.648+0000 7fcda7b91640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda0123c20 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.649+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 shutdown_connections 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.649+0000 7fcda7b91640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcd8403e930 0x7fcd84040e40 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.649+0000 7fcda7b91640 1 --2- 172.21.15.59:0/407767947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda00a0290 0x7fcda0123c20 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.649+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 >> 172.21.15.59:0/407767947 conn(0x7fcda009d9e0 msgr2=0x7fcda011ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.649+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 shutdown_connections 2024-09-16T17:05:26.650 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:26.649+0000 7fcda7b91640 1 -- 172.21.15.59:0/407767947 wait complete. 2024-09-16T17:05:26.669 INFO:tasks.workunit.client.0.smithi059.stderr:+ sleep 30 2024-09-16T17:05:56.671 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool delete 91fcba37-be76-447c-b31c-498d24e0adc8 91fcba37-be76-447c-b31c-498d24e0adc8 --yes-i-really-really-mean-it 2024-09-16T17:05:56.779 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.767+0000 7fbe1c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:56.780 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.780+0000 7fbe1c191640 1 Processor -- start 2024-09-16T17:05:56.781 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.780+0000 7fbe1c191640 1 -- start start 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe1c191640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe140a0290 0x7fbe140a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe1c191640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe140a12e0 con 0x7fbe140a0be0 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe1c191640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbe14071790 con 0x7fbe140a0290 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe19f2d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe140a0290 0x7fbe140a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe19f2d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe140a0290 0x7fbe140a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36766/0 (socket says 172.21.15.59:36766) 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe19f2d640 1 -- 172.21.15.59:0/3860838536 learned_addr learned my addr 172.21.15.59:0/3860838536 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe1972c640 1 --1- 172.21.15.59:0/3860838536 >> v1:172.21.15.59:6789/0 conn(0x7fbe140a0be0 0x7fbe14133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52308/0 (socket says 172.21.15.59:52308) 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe19f2d640 1 -- 172.21.15.59:0/3860838536 >> v1:172.21.15.59:6789/0 conn(0x7fbe140a0be0 legacy=0x7fbe14133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe18f2b640 1 -- 172.21.15.59:0/3860838536 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361776289 0 0) 0x7fbe140a12e0 con 0x7fbe140a0be0 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.782+0000 7fbe19f2d640 1 -- 172.21.15.59:0/3860838536 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe140a1c80 con 0x7fbe140a0290 2024-09-16T17:05:56.784 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.783+0000 7fbe19f2d640 1 --2- 172.21.15.59:0/3860838536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe140a06a0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8638a8d6cac8e6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:56.785 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.783+0000 7fbe18f2b640 1 -- 172.21.15.59:0/3860838536 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe10009e50 con 0x7fbe140a0290 2024-09-16T17:05:56.785 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.783+0000 7fbe18f2b640 1 -- 172.21.15.59:0/3860838536 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbe1000e230 con 0x7fbe140a0290 2024-09-16T17:05:56.785 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.783+0000 7fbe18f2b640 1 -- 172.21.15.59:0/3860838536 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe1000e4d0 con 0x7fbe140a0290 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 -- 172.21.15.59:0/3860838536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 msgr2=0x7fbe140a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 --2- 172.21.15.59:0/3860838536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe140a06a0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 -- 172.21.15.59:0/3860838536 shutdown_connections 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 --2- 172.21.15.59:0/3860838536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe140a06a0 unknown :-1 s=CLOSED pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 -- 172.21.15.59:0/3860838536 >> 172.21.15.59:0/3860838536 conn(0x7fbe1409d9e0 msgr2=0x7fbe1409ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 -- 172.21.15.59:0/3860838536 shutdown_connections 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 1 -- 172.21.15.59:0/3860838536 wait complete. 2024-09-16T17:05:56.786 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.784+0000 7fbe1c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:56.788 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.787+0000 7fbe1c191640 1 Processor -- start 2024-09-16T17:05:56.788 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.787+0000 7fbe1c191640 1 -- start start 2024-09-16T17:05:56.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.789+0000 7fbe1c191640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe141c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:56.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.789+0000 7fbe1c191640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe14123e00 con 0x7fbe140a0290 2024-09-16T17:05:56.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.789+0000 7fbe19f2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe141c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:56.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.789+0000 7fbe19f2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe141c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36776/0 (socket says 172.21.15.59:36776) 2024-09-16T17:05:56.790 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.789+0000 7fbe19f2d640 1 -- 172.21.15.59:0/4139608200 learned_addr learned my addr 172.21.15.59:0/4139608200 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:56.791 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe19f2d640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe141263a0 con 0x7fbe140a0290 2024-09-16T17:05:56.791 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe19f2d640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe141c8590 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:56.791 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe1000edc0 con 0x7fbe140a0290 2024-09-16T17:05:56.791 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbe10015420 con 0x7fbe140a0290 2024-09-16T17:05:56.792 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe14070e30 con 0x7fbe140a0290 2024-09-16T17:05:56.792 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe100156c0 con 0x7fbe140a0290 2024-09-16T17:05:56.792 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.790+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe140a41d0 con 0x7fbe140a0290 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.791+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbe10015870 con 0x7fbe140a0290 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.791+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe140a43b0 con 0x7fbe140a0290 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.792+0000 7fbe0a7fc640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbdf803e930 0x7fbdf8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.792+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(722..722 src has 403..722) ==== 4207+0+0 (crc 0 0 0) 0x7fbe100512d0 con 0x7fbe140a0290 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.792+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7fbdf8045360 con 0x7fbe140a0290 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.792+0000 7fbe1972c640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbdf803e930 0x7fbdf8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:56.793 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.793+0000 7fbe1972c640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbdf803e930 0x7fbdf8040e40 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:56.798 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:56.798+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbe140a43b0 con 0x7fbe140a0290 2024-09-16T17:05:57.001 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.000+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pool2": "91fcba37-be76-447c-b31c-498d24e0adc8", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbe14071b20 con 0x7fbe140a0290 2024-09-16T17:05:57.038 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.037+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pool2": "91fcba37-be76-447c-b31c-498d24e0adc8", "yes_i_really_really_mean_it": true}]=0 pool '91fcba37-be76-447c-b31c-498d24e0adc8' removed v723) ==== 248+0+0 (crc 0 0 0) 0x7fbe1000f2a0 con 0x7fbe140a0290 2024-09-16T17:05:57.038 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.037+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(723..723 src has 403..723) ==== 296+0+0 (crc 0 0 0) 0x7fbe10011e00 con 0x7fbe140a0290 2024-09-16T17:05:57.038 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.037+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7fbdf8045de0 con 0x7fbe140a0290 2024-09-16T17:05:57.199 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.199+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pool2": "91fcba37-be76-447c-b31c-498d24e0adc8", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbe140a20b0 con 0x7fbe140a0290 2024-09-16T17:05:57.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.199+0000 7fbe0a7fc640 1 -- 172.21.15.59:0/4139608200 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "91fcba37-be76-447c-b31c-498d24e0adc8", "pool2": "91fcba37-be76-447c-b31c-498d24e0adc8", "yes_i_really_really_mean_it": true}]=0 pool '91fcba37-be76-447c-b31c-498d24e0adc8' does not exist v723) ==== 255+0+0 (crc 0 0 0) 0x7fbe100109c0 con 0x7fbe140a0290 2024-09-16T17:05:57.200 INFO:tasks.workunit.client.0.smithi059.stderr:pool '91fcba37-be76-447c-b31c-498d24e0adc8' does not exist 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.201+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbdf803e930 msgr2=0x7fbdf8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.201+0000 7fbe1c191640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbdf803e930 0x7fbdf8040e40 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 msgr2=0x7fbe141c8590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe141c8590 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 shutdown_connections 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fbdf803e930 0x7fbdf8040e40 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 --2- 172.21.15.59:0/4139608200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe140a0290 0x7fbe141c8590 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 >> 172.21.15.59:0/4139608200 conn(0x7fbe1409d9e0 msgr2=0x7fbe1411ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 shutdown_connections 2024-09-16T17:05:57.203 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.202+0000 7fbe1c191640 1 -- 172.21.15.59:0/4139608200 wait complete. 2024-09-16T17:05:57.212 INFO:tasks.workunit.client.0.smithi059.stderr:+ ceph osd pool delete 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 9b5b3b2b-e590-4eec-a88a-e84fc688ffb6 --yes-i-really-really-mean-it 2024-09-16T17:05:57.309 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.299+0000 7f0675f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:57.310 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.309+0000 7f0675f91640 1 Processor -- start 2024-09-16T17:05:57.310 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.309+0000 7f0675f91640 1 -- start start 2024-09-16T17:05:57.312 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f0675f91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0670134150 0x7f0670134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f0675f91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067009dda0 con 0x7f0670072cd0 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f0675f91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f06700a6280 con 0x7f0670134150 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066f7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0670134150 0x7f0670134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066effd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0670072cd0 0x7f06700730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52310/0 (socket says 172.21.15.59:52310) 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066f7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0670134150 0x7f0670134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36790/0 (socket says 172.21.15.59:36790) 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066effd640 1 -- 172.21.15.59:0/3827010104 learned_addr learned my addr 172.21.15.59:0/3827010104 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066f7fe640 1 -- 172.21.15.59:0/3827010104 >> v1:172.21.15.59:6789/0 conn(0x7f0670072cd0 legacy=0x7f06700730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066e7fc640 1 -- 172.21.15.59:0/3827010104 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370314934 0 0) 0x7f067009dda0 con 0x7f0670072cd0 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.311+0000 7f066f7fe640 1 -- 172.21.15.59:0/3827010104 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067009ef80 con 0x7f0670134150 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.312+0000 7f066f7fe640 1 --2- 172.21.15.59:0/3827010104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670134150 0x7f0670134560 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc5a685eb597558 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.312+0000 7f066e7fc640 1 -- 172.21.15.59:0/3827010104 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0660009d90 con 0x7f0670134150 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.312+0000 7f066e7fc640 1 -- 172.21.15.59:0/3827010104 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f066000e230 con 0x7f0670134150 2024-09-16T17:05:57.313 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.312+0000 7f066e7fc640 1 -- 172.21.15.59:0/3827010104 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f066000e4d0 con 0x7f0670134150 2024-09-16T17:05:57.314 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.312+0000 7f0675f91640 1 -- 172.21.15.59:0/3827010104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670134150 msgr2=0x7f0670134560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:57.314 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.312+0000 7f0675f91640 1 --2- 172.21.15.59:0/3827010104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670134150 0x7f0670134560 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:57.314 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.313+0000 7f0675f91640 1 -- 172.21.15.59:0/3827010104 shutdown_connections 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.313+0000 7f0675f91640 1 --2- 172.21.15.59:0/3827010104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670134150 0x7f0670134560 unknown :-1 s=CLOSED pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.313+0000 7f0675f91640 1 -- 172.21.15.59:0/3827010104 >> 172.21.15.59:0/3827010104 conn(0x7f06700a43d0 msgr2=0x7f06700a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.313+0000 7f0675f91640 1 -- 172.21.15.59:0/3827010104 shutdown_connections 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.313+0000 7f0675f91640 1 -- 172.21.15.59:0/3827010104 wait complete. 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.313+0000 7f0675f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.315+0000 7f0675f91640 1 Processor -- start 2024-09-16T17:05:57.315 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.315+0000 7f0675f91640 1 -- start start 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.316+0000 7f0675f91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 0x7f0670120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.316+0000 7f0675f91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0670122460 con 0x7f0670072cd0 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.316+0000 7f066f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 0x7f0670120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.316+0000 7f066f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 0x7f0670120f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36800/0 (socket says 172.21.15.59:36800) 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.316+0000 7f066f7fe640 1 -- 172.21.15.59:0/2994452331 learned_addr learned my addr 172.21.15.59:0/2994452331 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f066f7fe640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0670124fb0 con 0x7f0670072cd0 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f066f7fe640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 0x7f0670120f60 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:57.318 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0660013530 con 0x7f0670072cd0 2024-09-16T17:05:57.319 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0660013690 con 0x7f0670072cd0 2024-09-16T17:05:57.319 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06701243a0 con 0x7f0670072cd0 2024-09-16T17:05:57.319 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0660013930 con 0x7f0670072cd0 2024-09-16T17:05:57.319 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.317+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06701229e0 con 0x7f0670072cd0 2024-09-16T17:05:57.319 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.318+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06700a5f00 con 0x7f0670072cd0 2024-09-16T17:05:57.320 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.318+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0660013b30 con 0x7f0670072cd0 2024-09-16T17:05:57.320 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.319+0000 7f0657fff640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f065c03e8e0 0x7f065c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:57.320 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.319+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(723..723 src has 403..723) ==== 3819+0+0 (crc 0 0 0) 0x7f0660018040 con 0x7f0670072cd0 2024-09-16T17:05:57.320 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.319+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7f065c044b70 con 0x7f0670072cd0 2024-09-16T17:05:57.320 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.319+0000 7f066effd640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f065c03e8e0 0x7f065c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:57.320 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.320+0000 7f066effd640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f065c03e8e0 0x7f065c040df0 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:57.324 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.324+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0660011380 con 0x7f0670072cd0 2024-09-16T17:05:57.510 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:57.510+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pool2": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "yes_i_really_really_mean_it": true} v 0) -- 0x7f067009dfb0 con 0x7f0670072cd0 2024-09-16T17:05:58.045 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.044+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pool2": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "yes_i_really_really_mean_it": true}]=0 pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' removed v724) ==== 248+0+0 (crc 0 0 0) 0x7f0660017190 con 0x7f0670072cd0 2024-09-16T17:05:58.045 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.045+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 8 ==== osd_map(724..724 src has 403..724) ==== 296+0+0 (crc 0 0 0) 0x7f0660013de0 con 0x7f0670072cd0 2024-09-16T17:05:58.045 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.045+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=725}) -- 0x7f065c0457a0 con 0x7f0670072cd0 2024-09-16T17:05:58.200 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.199+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pool2": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0670077cd0 con 0x7f0670072cd0 2024-09-16T17:05:58.201 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.200+0000 7f0657fff640 1 -- 172.21.15.59:0/2994452331 <== mon.0 v2:172.21.15.59:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "pool2": "9b5b3b2b-e590-4eec-a88a-e84fc688ffb6", "yes_i_really_really_mean_it": true}]=0 pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' does not exist v724) ==== 255+0+0 (crc 0 0 0) 0x7f0660018bf0 con 0x7f0670072cd0 2024-09-16T17:05:58.201 INFO:tasks.workunit.client.0.smithi059.stderr:pool '9b5b3b2b-e590-4eec-a88a-e84fc688ffb6' does not exist 2024-09-16T17:05:58.204 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f065c03e8e0 msgr2=0x7f065c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f065c03e8e0 0x7f065c040df0 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 msgr2=0x7f0670120f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 0x7f0670120f60 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 shutdown_connections 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f065c03e8e0 0x7f065c040df0 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 --2- 172.21.15.59:0/2994452331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0670072cd0 0x7f0670120f60 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.203+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 >> 172.21.15.59:0/2994452331 conn(0x7f06700a43d0 msgr2=0x7f06701335d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.204+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 shutdown_connections 2024-09-16T17:05:58.205 INFO:tasks.workunit.client.0.smithi059.stderr:2024-09-16T17:05:58.204+0000 7f0675f91640 1 -- 172.21.15.59:0/2994452331 wait complete. 2024-09-16T17:05:58.219 INFO:tasks.workunit.client.0.smithi059.stderr:+ echo OK 2024-09-16T17:05:58.220 INFO:tasks.workunit.client.0.smithi059.stdout:OK 2024-09-16T17:05:58.220 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T17:05:58.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T17:05:58.287 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-16T17:05:58.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T17:05:58.632 DEBUG:teuthology.parallel:result is None 2024-09-16T17:05:58.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:05:58.659 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:05:58.659 DEBUG:teuthology.orchestra.run.smithi059:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T17:05:58.722 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:05:58.722 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T17:05:58.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T17:05:58.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:05:58.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.875+0000 7f3131d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:58.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.885+0000 7f3131d51640 1 Processor -- start 2024-09-16T17:05:58.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.885+0000 7f3131d51640 1 -- start start 2024-09-16T17:05:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f3131d51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f312c09db00 0x7f312c09df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f3131d51640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f312c09ed40 con 0x7f312c09e450 2024-09-16T17:05:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f3131d51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f312c0a0700 con 0x7f312c09db00 2024-09-16T17:05:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f312b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f312c09db00 0x7f312c09df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f312affd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f312c09e450 0x7f312c138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52324/0 (socket says 172.21.15.59:52324) 2024-09-16T17:05:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f312b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f312c09db00 0x7f312c09df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36806/0 (socket says 172.21.15.59:36806) 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.886+0000 7f312affd640 1 -- 172.21.15.59:0/3351070186 learned_addr learned my addr 172.21.15.59:0/3351070186 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312b7fe640 1 -- 172.21.15.59:0/3351070186 >> v1:172.21.15.59:6789/0 conn(0x7f312c09e450 legacy=0x7f312c138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312b7fe640 1 -- 172.21.15.59:0/3351070186 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c09fbd0 con 0x7f312c09db00 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312a7fc640 1 -- 172.21.15.59:0/3351070186 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737471697 0 0) 0x7f312c09ed40 con 0x7f312c09e450 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312b7fe640 1 --2- 172.21.15.59:0/3351070186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c09df10 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e614dae52e1833a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312a7fc640 1 -- 172.21.15.59:0/3351070186 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c009d80 con 0x7f312c09db00 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312a7fc640 1 -- 172.21.15.59:0/3351070186 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f311c00e230 con 0x7f312c09db00 2024-09-16T17:05:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.887+0000 7f312a7fc640 1 -- 172.21.15.59:0/3351070186 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c00e4d0 con 0x7f312c09db00 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 -- 172.21.15.59:0/3351070186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 msgr2=0x7f312c09df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 --2- 172.21.15.59:0/3351070186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c09df10 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 -- 172.21.15.59:0/3351070186 shutdown_connections 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 --2- 172.21.15.59:0/3351070186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c09df10 unknown :-1 s=CLOSED pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 -- 172.21.15.59:0/3351070186 >> 172.21.15.59:0/3351070186 conn(0x7f312c0a45b0 msgr2=0x7f312c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 -- 172.21.15.59:0/3351070186 shutdown_connections 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 1 -- 172.21.15.59:0/3351070186 wait complete. 2024-09-16T17:05:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.888+0000 7f3131d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.890+0000 7f3131d51640 1 Processor -- start 2024-09-16T17:05:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.890+0000 7f3131d51640 1 -- start start 2024-09-16T17:05:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3131d51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c093280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3131d51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f312c097120 con 0x7f312c09db00 2024-09-16T17:05:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f312b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c093280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f312b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c093280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36820/0 (socket says 172.21.15.59:36820) 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f312b7fe640 1 -- 172.21.15.59:0/2698571108 learned_addr learned my addr 172.21.15.59:0/2698571108 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f312b7fe640 1 -- 172.21.15.59:0/2698571108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c096260 con 0x7f312c09db00 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f312b7fe640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c093280 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c013610 con 0x7f312c09db00 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f311c013770 con 0x7f312c09db00 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c074580 con 0x7f312c09db00 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f311c013a10 con 0x7f312c09db00 2024-09-16T17:05:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.892+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c095ec0 con 0x7f312c09db00 2024-09-16T17:05:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.894+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312c0008d0 con 0x7f312c09db00 2024-09-16T17:05:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.894+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f311c013bc0 con 0x7f312c09db00 2024-09-16T17:05:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.894+0000 7f3113fff640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f311803e960 0x7f3118040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.894+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f311c018040 con 0x7f312c09db00 2024-09-16T17:05:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.894+0000 7f312affd640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f311803e960 0x7f3118040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.895+0000 7f312affd640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f311803e960 0x7f3118040e70 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:58.899+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f311c011380 con 0x7f312c09db00 2024-09-16T17:05:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.079+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f312c09a620 con 0x7f311803e960 2024-09-16T17:05:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.082+0000 7f3113fff640 1 -- 172.21.15.59:0/2698571108 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109238 (crc 0 0 0) 0x7f3120005930 con 0x7f311803e960 2024-09-16T17:05:59.084 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:05:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T17:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f311803e960 msgr2=0x7f3118040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f311803e960 0x7f3118040e70 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 msgr2=0x7f312c093280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c093280 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 shutdown_connections 2024-09-16T17:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f311803e960 0x7f3118040e70 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 --2- 172.21.15.59:0/2698571108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f312c09db00 0x7f312c093280 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 >> 172.21.15.59:0/2698571108 conn(0x7f312c0a45b0 msgr2=0x7f312c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 shutdown_connections 2024-09-16T17:05:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.084+0000 7f3131d51640 1 -- 172.21.15.59:0/2698571108 wait complete. 2024-09-16T17:05:59.097 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":1286,"stamp":"2024-09-16T17:05:58.045921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":263200,"kb_used_data":14304,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377224160,"statfs":{"total":386547056640,"available":386277539840,"internally_reserved":0,"allocated":14647296,"data_stored":7179034,"data_compressed":354486,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.068518"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.679314+0000","last_change":"2024-09-16T16:52:04.699706+0000","last_active":"2024-09-16T17:05:26.679314+0000","last_peered":"2024-09-16T17:05:26.679314+0000","last_clean":"2024-09-16T17:05:26.679314+0000","last_became_active":"2024-09-16T16:52:04.683267+0000","last_became_peered":"2024-09-16T16:52:04.683267+0000","last_unstale":"2024-09-16T17:05:26.679314+0000","last_undegraded":"2024-09-16T17:05:26.679314+0000","last_fullsized":"2024-09-16T17:05:26.679314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.685412+0000","last_change":"2024-09-16T16:52:04.761758+0000","last_active":"2024-09-16T17:05:26.685412+0000","last_peered":"2024-09-16T17:05:26.685412+0000","last_clean":"2024-09-16T17:05:26.685412+0000","last_became_active":"2024-09-16T16:52:04.744118+0000","last_became_peered":"2024-09-16T16:52:04.744118+0000","last_unstale":"2024-09-16T17:05:26.685412+0000","last_undegraded":"2024-09-16T17:05:26.685412+0000","last_fullsized":"2024-09-16T17:05:26.685412+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.667865+0000","last_change":"2024-09-16T16:52:04.668513+0000","last_active":"2024-09-16T17:05:26.667865+0000","last_peered":"2024-09-16T17:05:26.667865+0000","last_clean":"2024-09-16T17:05:26.667865+0000","last_became_active":"2024-09-16T16:52:04.659260+0000","last_became_peered":"2024-09-16T16:52:04.659260+0000","last_unstale":"2024-09-16T17:05:26.667865+0000","last_undegraded":"2024-09-16T17:05:26.667865+0000","last_fullsized":"2024-09-16T17:05:26.667865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666497+0000","last_change":"2024-09-16T16:52:04.720609+0000","last_active":"2024-09-16T17:05:26.666497+0000","last_peered":"2024-09-16T17:05:26.666497+0000","last_clean":"2024-09-16T17:05:26.666497+0000","last_became_active":"2024-09-16T16:52:04.707958+0000","last_became_peered":"2024-09-16T16:52:04.707958+0000","last_unstale":"2024-09-16T17:05:26.666497+0000","last_undegraded":"2024-09-16T17:05:26.666497+0000","last_fullsized":"2024-09-16T17:05:26.666497+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.669945+0000","last_change":"2024-09-16T16:52:04.663528+0000","last_active":"2024-09-16T17:05:26.669945+0000","last_peered":"2024-09-16T17:05:26.669945+0000","last_clean":"2024-09-16T17:05:26.669945+0000","last_became_active":"2024-09-16T16:52:04.655240+0000","last_became_peered":"2024-09-16T16:52:04.655240+0000","last_unstale":"2024-09-16T17:05:26.669945+0000","last_undegraded":"2024-09-16T17:05:26.669945+0000","last_fullsized":"2024-09-16T17:05:26.669945+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.672028+0000","last_change":"2024-09-16T16:52:04.673009+0000","last_active":"2024-09-16T17:05:26.672028+0000","last_peered":"2024-09-16T17:05:26.672028+0000","last_clean":"2024-09-16T17:05:26.672028+0000","last_became_active":"2024-09-16T16:52:04.655040+0000","last_became_peered":"2024-09-16T16:52:04.655040+0000","last_unstale":"2024-09-16T17:05:26.672028+0000","last_undegraded":"2024-09-16T17:05:26.672028+0000","last_fullsized":"2024-09-16T17:05:26.672028+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.679148+0000","last_change":"2024-09-16T16:52:04.834460+0000","last_active":"2024-09-16T17:05:26.679148+0000","last_peered":"2024-09-16T17:05:26.679148+0000","last_clean":"2024-09-16T17:05:26.679148+0000","last_became_active":"2024-09-16T16:52:04.822727+0000","last_became_peered":"2024-09-16T16:52:04.822727+0000","last_unstale":"2024-09-16T17:05:26.679148+0000","last_undegraded":"2024-09-16T17:05:26.679148+0000","last_fullsized":"2024-09-16T17:05:26.679148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.684928+0000","last_change":"2024-09-16T16:52:04.766288+0000","last_active":"2024-09-16T17:05:26.684928+0000","last_peered":"2024-09-16T17:05:26.684928+0000","last_clean":"2024-09-16T17:05:26.684928+0000","last_became_active":"2024-09-16T16:52:04.749230+0000","last_became_peered":"2024-09-16T16:52:04.749230+0000","last_unstale":"2024-09-16T17:05:26.684928+0000","last_undegraded":"2024-09-16T17:05:26.684928+0000","last_fullsized":"2024-09-16T17:05:26.684928+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.668759+0000","last_change":"2024-09-16T16:52:04.733335+0000","last_active":"2024-09-16T17:05:26.668759+0000","last_peered":"2024-09-16T17:05:26.668759+0000","last_clean":"2024-09-16T17:05:26.668759+0000","last_became_active":"2024-09-16T16:52:04.722821+0000","last_became_peered":"2024-09-16T16:52:04.722821+0000","last_unstale":"2024-09-16T17:05:26.668759+0000","last_undegraded":"2024-09-16T17:05:26.668759+0000","last_fullsized":"2024-09-16T17:05:26.668759+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.662354+0000","last_change":"2024-09-16T16:52:04.641248+0000","last_active":"2024-09-16T17:05:26.662354+0000","last_peered":"2024-09-16T17:05:26.662354+0000","last_clean":"2024-09-16T17:05:26.662354+0000","last_became_active":"2024-09-16T16:52:04.628000+0000","last_became_peered":"2024-09-16T16:52:04.628000+0000","last_unstale":"2024-09-16T17:05:26.662354+0000","last_undegraded":"2024-09-16T17:05:26.662354+0000","last_fullsized":"2024-09-16T17:05:26.662354+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.662894+0000","last_change":"2024-09-16T16:52:04.684071+0000","last_active":"2024-09-16T17:05:26.662894+0000","last_peered":"2024-09-16T17:05:26.662894+0000","last_clean":"2024-09-16T17:05:26.662894+0000","last_became_active":"2024-09-16T16:52:04.660722+0000","last_became_peered":"2024-09-16T16:52:04.660722+0000","last_unstale":"2024-09-16T17:05:26.662894+0000","last_undegraded":"2024-09-16T17:05:26.662894+0000","last_fullsized":"2024-09-16T17:05:26.662894+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.669468+0000","last_change":"2024-09-16T16:52:04.751809+0000","last_active":"2024-09-16T17:05:26.669468+0000","last_peered":"2024-09-16T17:05:26.669468+0000","last_clean":"2024-09-16T17:05:26.669468+0000","last_became_active":"2024-09-16T16:52:04.705911+0000","last_became_peered":"2024-09-16T16:52:04.705911+0000","last_unstale":"2024-09-16T17:05:26.669468+0000","last_undegraded":"2024-09-16T17:05:26.669468+0000","last_fullsized":"2024-09-16T17:05:26.669468+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675979+0000","last_change":"2024-09-16T16:52:04.722993+0000","last_active":"2024-09-16T17:05:26.675979+0000","last_peered":"2024-09-16T17:05:26.675979+0000","last_clean":"2024-09-16T17:05:26.675979+0000","last_became_active":"2024-09-16T16:52:04.711500+0000","last_became_peered":"2024-09-16T16:52:04.711500+0000","last_unstale":"2024-09-16T17:05:26.675979+0000","last_undegraded":"2024-09-16T17:05:26.675979+0000","last_fullsized":"2024-09-16T17:05:26.675979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666810+0000","last_change":"2024-09-16T16:52:04.788750+0000","last_active":"2024-09-16T17:05:26.666810+0000","last_peered":"2024-09-16T17:05:26.666810+0000","last_clean":"2024-09-16T17:05:26.666810+0000","last_became_active":"2024-09-16T16:52:04.784535+0000","last_became_peered":"2024-09-16T16:52:04.784535+0000","last_unstale":"2024-09-16T17:05:26.666810+0000","last_undegraded":"2024-09-16T17:05:26.666810+0000","last_fullsized":"2024-09-16T17:05:26.666810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.680010+0000","last_change":"2024-09-16T16:52:04.746337+0000","last_active":"2024-09-16T17:05:26.680010+0000","last_peered":"2024-09-16T17:05:26.680010+0000","last_clean":"2024-09-16T17:05:26.680010+0000","last_became_active":"2024-09-16T16:52:04.727116+0000","last_became_peered":"2024-09-16T16:52:04.727116+0000","last_unstale":"2024-09-16T17:05:26.680010+0000","last_undegraded":"2024-09-16T17:05:26.680010+0000","last_fullsized":"2024-09-16T17:05:26.680010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.683399+0000","last_change":"2024-09-16T16:52:04.827442+0000","last_active":"2024-09-16T17:05:26.683399+0000","last_peered":"2024-09-16T17:05:26.683399+0000","last_clean":"2024-09-16T17:05:26.683399+0000","last_became_active":"2024-09-16T16:52:04.814429+0000","last_became_peered":"2024-09-16T16:52:04.814429+0000","last_unstale":"2024-09-16T17:05:26.683399+0000","last_undegraded":"2024-09-16T17:05:26.683399+0000","last_fullsized":"2024-09-16T17:05:26.683399+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.681490+0000","last_change":"2024-09-16T16:52:04.730899+0000","last_active":"2024-09-16T17:05:26.681490+0000","last_peered":"2024-09-16T17:05:26.681490+0000","last_clean":"2024-09-16T17:05:26.681490+0000","last_became_active":"2024-09-16T16:52:04.704696+0000","last_became_peered":"2024-09-16T16:52:04.704696+0000","last_unstale":"2024-09-16T17:05:26.681490+0000","last_undegraded":"2024-09-16T17:05:26.681490+0000","last_fullsized":"2024-09-16T17:05:26.681490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.667568+0000","last_change":"2024-09-16T16:52:04.688424+0000","last_active":"2024-09-16T17:05:26.667568+0000","last_peered":"2024-09-16T17:05:26.667568+0000","last_clean":"2024-09-16T17:05:26.667568+0000","last_became_active":"2024-09-16T16:52:04.668455+0000","last_became_peered":"2024-09-16T16:52:04.668455+0000","last_unstale":"2024-09-16T17:05:26.667568+0000","last_undegraded":"2024-09-16T17:05:26.667568+0000","last_fullsized":"2024-09-16T17:05:26.667568+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.660886+0000","last_change":"2024-09-16T16:52:04.664921+0000","last_active":"2024-09-16T17:05:26.660886+0000","last_peered":"2024-09-16T17:05:26.660886+0000","last_clean":"2024-09-16T17:05:26.660886+0000","last_became_active":"2024-09-16T16:52:04.647610+0000","last_became_peered":"2024-09-16T16:52:04.647610+0000","last_unstale":"2024-09-16T17:05:26.660886+0000","last_undegraded":"2024-09-16T17:05:26.660886+0000","last_fullsized":"2024-09-16T17:05:26.660886+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.677430+0000","last_change":"2024-09-16T16:52:04.763162+0000","last_active":"2024-09-16T17:05:26.677430+0000","last_peered":"2024-09-16T17:05:26.677430+0000","last_clean":"2024-09-16T17:05:26.677430+0000","last_became_active":"2024-09-16T16:52:04.755722+0000","last_became_peered":"2024-09-16T16:52:04.755722+0000","last_unstale":"2024-09-16T17:05:26.677430+0000","last_undegraded":"2024-09-16T17:05:26.677430+0000","last_fullsized":"2024-09-16T17:05:26.677430+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.682275+0000","last_change":"2024-09-16T16:52:04.797949+0000","last_active":"2024-09-16T17:05:26.682275+0000","last_peered":"2024-09-16T17:05:26.682275+0000","last_clean":"2024-09-16T17:05:26.682275+0000","last_became_active":"2024-09-16T16:52:04.791745+0000","last_became_peered":"2024-09-16T16:52:04.791745+0000","last_unstale":"2024-09-16T17:05:26.682275+0000","last_undegraded":"2024-09-16T17:05:26.682275+0000","last_fullsized":"2024-09-16T17:05:26.682275+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.670799+0000","last_change":"2024-09-16T16:52:04.698664+0000","last_active":"2024-09-16T17:05:26.670799+0000","last_peered":"2024-09-16T17:05:26.670799+0000","last_clean":"2024-09-16T17:05:26.670799+0000","last_became_active":"2024-09-16T16:52:04.686232+0000","last_became_peered":"2024-09-16T16:52:04.686232+0000","last_unstale":"2024-09-16T17:05:26.670799+0000","last_undegraded":"2024-09-16T17:05:26.670799+0000","last_fullsized":"2024-09-16T17:05:26.670799+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.668344+0000","last_change":"2024-09-16T16:52:04.682117+0000","last_active":"2024-09-16T17:05:26.668344+0000","last_peered":"2024-09-16T17:05:26.668344+0000","last_clean":"2024-09-16T17:05:26.668344+0000","last_became_active":"2024-09-16T16:52:04.674267+0000","last_became_peered":"2024-09-16T16:52:04.674267+0000","last_unstale":"2024-09-16T17:05:26.668344+0000","last_undegraded":"2024-09-16T17:05:26.668344+0000","last_fullsized":"2024-09-16T17:05:26.668344+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666035+0000","last_change":"2024-09-16T16:52:04.678055+0000","last_active":"2024-09-16T17:05:26.666035+0000","last_peered":"2024-09-16T17:05:26.666035+0000","last_clean":"2024-09-16T17:05:26.666035+0000","last_became_active":"2024-09-16T16:52:04.651245+0000","last_became_peered":"2024-09-16T16:52:04.651245+0000","last_unstale":"2024-09-16T17:05:26.666035+0000","last_undegraded":"2024-09-16T17:05:26.666035+0000","last_fullsized":"2024-09-16T17:05:26.666035+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675175+0000","last_change":"2024-09-16T16:52:04.725681+0000","last_active":"2024-09-16T17:05:26.675175+0000","last_peered":"2024-09-16T17:05:26.675175+0000","last_clean":"2024-09-16T17:05:26.675175+0000","last_became_active":"2024-09-16T16:52:04.716567+0000","last_became_peered":"2024-09-16T16:52:04.716567+0000","last_unstale":"2024-09-16T17:05:26.675175+0000","last_undegraded":"2024-09-16T17:05:26.675175+0000","last_fullsized":"2024-09-16T17:05:26.675175+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.673985+0000","last_change":"2024-09-16T16:52:04.848189+0000","last_active":"2024-09-16T17:05:26.673985+0000","last_peered":"2024-09-16T17:05:26.673985+0000","last_clean":"2024-09-16T17:05:26.673985+0000","last_became_active":"2024-09-16T16:52:04.840298+0000","last_became_peered":"2024-09-16T16:52:04.840298+0000","last_unstale":"2024-09-16T17:05:26.673985+0000","last_undegraded":"2024-09-16T17:05:26.673985+0000","last_fullsized":"2024-09-16T17:05:26.673985+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675782+0000","last_change":"2024-09-16T16:52:04.756769+0000","last_active":"2024-09-16T17:05:26.675782+0000","last_peered":"2024-09-16T17:05:26.675782+0000","last_clean":"2024-09-16T17:05:26.675782+0000","last_became_active":"2024-09-16T16:52:04.751100+0000","last_became_peered":"2024-09-16T16:52:04.751100+0000","last_unstale":"2024-09-16T17:05:26.675782+0000","last_undegraded":"2024-09-16T17:05:26.675782+0000","last_fullsized":"2024-09-16T17:05:26.675782+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675237+0000","last_change":"2024-09-16T16:52:04.797030+0000","last_active":"2024-09-16T17:05:26.675237+0000","last_peered":"2024-09-16T17:05:26.675237+0000","last_clean":"2024-09-16T17:05:26.675237+0000","last_became_active":"2024-09-16T16:52:04.789190+0000","last_became_peered":"2024-09-16T16:52:04.789190+0000","last_unstale":"2024-09-16T17:05:26.675237+0000","last_undegraded":"2024-09-16T17:05:26.675237+0000","last_fullsized":"2024-09-16T17:05:26.675237+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.680503+0000","last_change":"2024-09-16T16:52:04.818516+0000","last_active":"2024-09-16T17:05:26.680503+0000","last_peered":"2024-09-16T17:05:26.680503+0000","last_clean":"2024-09-16T17:05:26.680503+0000","last_became_active":"2024-09-16T16:52:04.805951+0000","last_became_peered":"2024-09-16T16:52:04.805951+0000","last_unstale":"2024-09-16T17:05:26.680503+0000","last_undegraded":"2024-09-16T17:05:26.680503+0000","last_fullsized":"2024-09-16T17:05:26.680503+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666880+0000","last_change":"2024-09-16T16:52:04.747686+0000","last_active":"2024-09-16T17:05:26.666880+0000","last_peered":"2024-09-16T17:05:26.666880+0000","last_clean":"2024-09-16T17:05:26.666880+0000","last_became_active":"2024-09-16T16:52:04.711856+0000","last_became_peered":"2024-09-16T16:52:04.711856+0000","last_unstale":"2024-09-16T17:05:26.666880+0000","last_undegraded":"2024-09-16T17:05:26.666880+0000","last_fullsized":"2024-09-16T17:05:26.666880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1476,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.686366+0000","last_change":"2024-09-16T16:52:04.693250+0000","last_active":"2024-09-16T17:05:26.686366+0000","last_peered":"2024-09-16T17:05:26.686366+0000","last_clean":"2024-09-16T17:05:26.686366+0000","last_became_active":"2024-09-16T16:52:04.671009+0000","last_became_peered":"2024-09-16T16:52:04.671009+0000","last_unstale":"2024-09-16T17:05:26.686366+0000","last_undegraded":"2024-09-16T17:05:26.686366+0000","last_fullsized":"2024-09-16T17:05:26.686366+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.674375+0000","last_change":"2024-09-16T16:52:04.674154+0000","last_active":"2024-09-16T17:05:26.674375+0000","last_peered":"2024-09-16T17:05:26.674375+0000","last_clean":"2024-09-16T17:05:26.674375+0000","last_became_active":"2024-09-16T16:52:04.662483+0000","last_became_peered":"2024-09-16T16:52:04.662483+0000","last_unstale":"2024-09-16T17:05:26.674375+0000","last_undegraded":"2024-09-16T17:05:26.674375+0000","last_fullsized":"2024-09-16T17:05:26.674375+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.672010+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T17:05:26.672010+0000","last_peered":"2024-09-16T17:05:26.672010+0000","last_clean":"2024-09-16T17:05:26.672010+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T17:05:26.672010+0000","last_undegraded":"2024-09-16T17:05:26.672010+0000","last_fullsized":"2024-09-16T17:05:26.672010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.678575+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T17:05:26.678575+0000","last_peered":"2024-09-16T17:05:26.678575+0000","last_clean":"2024-09-16T17:05:26.678575+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T17:05:26.678575+0000","last_undegraded":"2024-09-16T17:05:26.678575+0000","last_fullsized":"2024-09-16T17:05:26.678575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675054+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T17:05:26.675054+0000","last_peered":"2024-09-16T17:05:26.675054+0000","last_clean":"2024-09-16T17:05:26.675054+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T17:05:26.675054+0000","last_undegraded":"2024-09-16T17:05:26.675054+0000","last_fullsized":"2024-09-16T17:05:26.675054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.658592+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T17:05:26.658592+0000","last_peered":"2024-09-16T17:05:26.658592+0000","last_clean":"2024-09-16T17:05:26.658592+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T17:05:26.658592+0000","last_undegraded":"2024-09-16T17:05:26.658592+0000","last_fullsized":"2024-09-16T17:05:26.658592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.682734+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T17:05:26.682734+0000","last_peered":"2024-09-16T17:05:26.682734+0000","last_clean":"2024-09-16T17:05:26.682734+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T17:05:26.682734+0000","last_undegraded":"2024-09-16T17:05:26.682734+0000","last_fullsized":"2024-09-16T17:05:26.682734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.671332+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T17:05:26.671332+0000","last_peered":"2024-09-16T17:05:26.671332+0000","last_clean":"2024-09-16T17:05:26.671332+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T17:05:26.671332+0000","last_undegraded":"2024-09-16T17:05:26.671332+0000","last_fullsized":"2024-09-16T17:05:26.671332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.678519+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T17:05:26.678519+0000","last_peered":"2024-09-16T17:05:26.678519+0000","last_clean":"2024-09-16T17:05:26.678519+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T17:05:26.678519+0000","last_undegraded":"2024-09-16T17:05:26.678519+0000","last_fullsized":"2024-09-16T17:05:26.678519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.685172+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T17:05:26.685172+0000","last_peered":"2024-09-16T17:05:26.685172+0000","last_clean":"2024-09-16T17:05:26.685172+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T17:05:26.685172+0000","last_undegraded":"2024-09-16T17:05:26.685172+0000","last_fullsized":"2024-09-16T17:05:26.685172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2205,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.664688+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T17:05:26.664688+0000","last_peered":"2024-09-16T17:05:26.664688+0000","last_clean":"2024-09-16T17:05:26.664688+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T17:05:26.664688+0000","last_undegraded":"2024-09-16T17:05:26.664688+0000","last_fullsized":"2024-09-16T17:05:26.664688+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70696,"kb_used_data":3608,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301144,"statfs":{"total":96636764160,"available":96564371456,"internally_reserved":0,"allocated":3694592,"data_stored":2096368,"data_compressed":106587,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66472,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305368,"statfs":{"total":96636764160,"available":96568696832,"internally_reserved":0,"allocated":3629056,"data_stored":1493149,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65048,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306792,"statfs":{"total":96636764160,"available":96570155008,"internally_reserved":0,"allocated":3612672,"data_stored":1480255,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":2109262,"data_compressed":112475,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:05:59.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:05:59.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.207+0000 7f6f75e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:59.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.212+0000 7f6f75e9c640 1 Processor -- start 2024-09-16T17:05:59.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.212+0000 7f6f75e9c640 1 -- start start 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f75e9c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f7006f3f0 0x7f6f7013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f75e9c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f700a2bc0 con 0x7f6f7006e8d0 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f75e9c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6f700a2570 con 0x7f6f7006f3f0 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f6effd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f7006f3f0 0x7f6f7013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f6f7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6f7006e8d0 0x7f6f7006ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52340/0 (socket says 172.21.15.59:52340) 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f6effd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f7006f3f0 0x7f6f7013b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36834/0 (socket says 172.21.15.59:36834) 2024-09-16T17:05:59.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.214+0000 7f6f6f7fe640 1 -- 172.21.15.59:0/488254413 learned_addr learned my addr 172.21.15.59:0/488254413 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.215+0000 7f6f6effd640 1 -- 172.21.15.59:0/488254413 >> v1:172.21.15.59:6789/0 conn(0x7f6f7006e8d0 legacy=0x7f6f7006ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.215+0000 7f6f6effd640 1 -- 172.21.15.59:0/488254413 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7006ff70 con 0x7f6f7006f3f0 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.215+0000 7f6f6effd640 1 --2- 172.21.15.59:0/488254413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006f3f0 0x7f6f7013b420 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add782e5884a0659 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.215+0000 7f6f6e7fc640 1 -- 172.21.15.59:0/488254413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f64009d90 con 0x7f6f7006f3f0 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.215+0000 7f6f6e7fc640 1 -- 172.21.15.59:0/488254413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f6400e230 con 0x7f6f7006f3f0 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.215+0000 7f6f6e7fc640 1 -- 172.21.15.59:0/488254413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f6400e4d0 con 0x7f6f7006f3f0 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 -- 172.21.15.59:0/488254413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006f3f0 msgr2=0x7f6f7013b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 --2- 172.21.15.59:0/488254413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006f3f0 0x7f6f7013b420 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 -- 172.21.15.59:0/488254413 shutdown_connections 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 --2- 172.21.15.59:0/488254413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006f3f0 0x7f6f7013b420 unknown :-1 s=CLOSED pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 -- 172.21.15.59:0/488254413 >> 172.21.15.59:0/488254413 conn(0x7f6f700a3050 msgr2=0x7f6f700a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:59.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 -- 172.21.15.59:0/488254413 shutdown_connections 2024-09-16T17:05:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 1 -- 172.21.15.59:0/488254413 wait complete. 2024-09-16T17:05:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.216+0000 7f6f75e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.218+0000 7f6f75e9c640 1 Processor -- start 2024-09-16T17:05:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.218+0000 7f6f75e9c640 1 -- start start 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.219+0000 7f6f75e9c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 0x7f6f70125d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.219+0000 7f6f75e9c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6f70129970 con 0x7f6f7006e8d0 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.219+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 0x7f6f70125d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.219+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 0x7f6f70125d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36850/0 (socket says 172.21.15.59:36850) 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f6f7fe640 1 -- 172.21.15.59:0/1104622398 learned_addr learned my addr 172.21.15.59:0/1104622398 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f6f7fe640 1 -- 172.21.15.59:0/1104622398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f70129c20 con 0x7f6f7006e8d0 2024-09-16T17:05:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f6f7fe640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 0x7f6f70125d70 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f60005a60 con 0x7f6f7006e8d0 2024-09-16T17:05:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f60005bc0 con 0x7f6f7006e8d0 2024-09-16T17:05:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f701282c0 con 0x7f6f7006e8d0 2024-09-16T17:05:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f60005e60 con 0x7f6f7006e8d0 2024-09-16T17:05:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.220+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f70129610 con 0x7f6f7006e8d0 2024-09-16T17:05:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.221+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7006ece0 con 0x7f6f7006e8d0 2024-09-16T17:05:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.221+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6f6000c7f0 con 0x7f6f7006e8d0 2024-09-16T17:05:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.222+0000 7f6f57fff640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6f5c03e930 0x7f6f5c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.222+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f6f6004f990 con 0x7f6f7006e8d0 2024-09-16T17:05:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.222+0000 7f6f6effd640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6f5c03e930 0x7f6f5c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.222+0000 7f6f6effd640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6f5c03e930 0x7f6f5c040e40 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.227+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6f6000dc10 con 0x7f6f7006e8d0 2024-09-16T17:05:59.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.408+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f70129800 con 0x7f6f5c03e930 2024-09-16T17:05:59.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.411+0000 7f6f57fff640 1 -- 172.21.15.59:0/1104622398 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109238 (crc 0 0 0) 0x7f6f70129800 con 0x7f6f5c03e930 2024-09-16T17:05:59.412 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:05:59.413 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T17:05:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6f5c03e930 msgr2=0x7f6f5c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6f5c03e930 0x7f6f5c040e40 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 msgr2=0x7f6f70125d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 0x7f6f70125d70 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 shutdown_connections 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f6f5c03e930 0x7f6f5c040e40 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 --2- 172.21.15.59:0/1104622398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7006e8d0 0x7f6f70125d70 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.413+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 >> 172.21.15.59:0/1104622398 conn(0x7f6f700a3050 msgr2=0x7f6f700733d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.414+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 shutdown_connections 2024-09-16T17:05:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.414+0000 7f6f75e9c640 1 -- 172.21.15.59:0/1104622398 wait complete. 2024-09-16T17:05:59.426 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":1286,"stamp":"2024-09-16T17:05:58.045921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":263200,"kb_used_data":14304,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377224160,"statfs":{"total":386547056640,"available":386277539840,"internally_reserved":0,"allocated":14647296,"data_stored":7179034,"data_compressed":354486,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.068518"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.679314+0000","last_change":"2024-09-16T16:52:04.699706+0000","last_active":"2024-09-16T17:05:26.679314+0000","last_peered":"2024-09-16T17:05:26.679314+0000","last_clean":"2024-09-16T17:05:26.679314+0000","last_became_active":"2024-09-16T16:52:04.683267+0000","last_became_peered":"2024-09-16T16:52:04.683267+0000","last_unstale":"2024-09-16T17:05:26.679314+0000","last_undegraded":"2024-09-16T17:05:26.679314+0000","last_fullsized":"2024-09-16T17:05:26.679314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.685412+0000","last_change":"2024-09-16T16:52:04.761758+0000","last_active":"2024-09-16T17:05:26.685412+0000","last_peered":"2024-09-16T17:05:26.685412+0000","last_clean":"2024-09-16T17:05:26.685412+0000","last_became_active":"2024-09-16T16:52:04.744118+0000","last_became_peered":"2024-09-16T16:52:04.744118+0000","last_unstale":"2024-09-16T17:05:26.685412+0000","last_undegraded":"2024-09-16T17:05:26.685412+0000","last_fullsized":"2024-09-16T17:05:26.685412+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.667865+0000","last_change":"2024-09-16T16:52:04.668513+0000","last_active":"2024-09-16T17:05:26.667865+0000","last_peered":"2024-09-16T17:05:26.667865+0000","last_clean":"2024-09-16T17:05:26.667865+0000","last_became_active":"2024-09-16T16:52:04.659260+0000","last_became_peered":"2024-09-16T16:52:04.659260+0000","last_unstale":"2024-09-16T17:05:26.667865+0000","last_undegraded":"2024-09-16T17:05:26.667865+0000","last_fullsized":"2024-09-16T17:05:26.667865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666497+0000","last_change":"2024-09-16T16:52:04.720609+0000","last_active":"2024-09-16T17:05:26.666497+0000","last_peered":"2024-09-16T17:05:26.666497+0000","last_clean":"2024-09-16T17:05:26.666497+0000","last_became_active":"2024-09-16T16:52:04.707958+0000","last_became_peered":"2024-09-16T16:52:04.707958+0000","last_unstale":"2024-09-16T17:05:26.666497+0000","last_undegraded":"2024-09-16T17:05:26.666497+0000","last_fullsized":"2024-09-16T17:05:26.666497+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.669945+0000","last_change":"2024-09-16T16:52:04.663528+0000","last_active":"2024-09-16T17:05:26.669945+0000","last_peered":"2024-09-16T17:05:26.669945+0000","last_clean":"2024-09-16T17:05:26.669945+0000","last_became_active":"2024-09-16T16:52:04.655240+0000","last_became_peered":"2024-09-16T16:52:04.655240+0000","last_unstale":"2024-09-16T17:05:26.669945+0000","last_undegraded":"2024-09-16T17:05:26.669945+0000","last_fullsized":"2024-09-16T17:05:26.669945+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.672028+0000","last_change":"2024-09-16T16:52:04.673009+0000","last_active":"2024-09-16T17:05:26.672028+0000","last_peered":"2024-09-16T17:05:26.672028+0000","last_clean":"2024-09-16T17:05:26.672028+0000","last_became_active":"2024-09-16T16:52:04.655040+0000","last_became_peered":"2024-09-16T16:52:04.655040+0000","last_unstale":"2024-09-16T17:05:26.672028+0000","last_undegraded":"2024-09-16T17:05:26.672028+0000","last_fullsized":"2024-09-16T17:05:26.672028+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.679148+0000","last_change":"2024-09-16T16:52:04.834460+0000","last_active":"2024-09-16T17:05:26.679148+0000","last_peered":"2024-09-16T17:05:26.679148+0000","last_clean":"2024-09-16T17:05:26.679148+0000","last_became_active":"2024-09-16T16:52:04.822727+0000","last_became_peered":"2024-09-16T16:52:04.822727+0000","last_unstale":"2024-09-16T17:05:26.679148+0000","last_undegraded":"2024-09-16T17:05:26.679148+0000","last_fullsized":"2024-09-16T17:05:26.679148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.684928+0000","last_change":"2024-09-16T16:52:04.766288+0000","last_active":"2024-09-16T17:05:26.684928+0000","last_peered":"2024-09-16T17:05:26.684928+0000","last_clean":"2024-09-16T17:05:26.684928+0000","last_became_active":"2024-09-16T16:52:04.749230+0000","last_became_peered":"2024-09-16T16:52:04.749230+0000","last_unstale":"2024-09-16T17:05:26.684928+0000","last_undegraded":"2024-09-16T17:05:26.684928+0000","last_fullsized":"2024-09-16T17:05:26.684928+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.668759+0000","last_change":"2024-09-16T16:52:04.733335+0000","last_active":"2024-09-16T17:05:26.668759+0000","last_peered":"2024-09-16T17:05:26.668759+0000","last_clean":"2024-09-16T17:05:26.668759+0000","last_became_active":"2024-09-16T16:52:04.722821+0000","last_became_peered":"2024-09-16T16:52:04.722821+0000","last_unstale":"2024-09-16T17:05:26.668759+0000","last_undegraded":"2024-09-16T17:05:26.668759+0000","last_fullsized":"2024-09-16T17:05:26.668759+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.662354+0000","last_change":"2024-09-16T16:52:04.641248+0000","last_active":"2024-09-16T17:05:26.662354+0000","last_peered":"2024-09-16T17:05:26.662354+0000","last_clean":"2024-09-16T17:05:26.662354+0000","last_became_active":"2024-09-16T16:52:04.628000+0000","last_became_peered":"2024-09-16T16:52:04.628000+0000","last_unstale":"2024-09-16T17:05:26.662354+0000","last_undegraded":"2024-09-16T17:05:26.662354+0000","last_fullsized":"2024-09-16T17:05:26.662354+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.662894+0000","last_change":"2024-09-16T16:52:04.684071+0000","last_active":"2024-09-16T17:05:26.662894+0000","last_peered":"2024-09-16T17:05:26.662894+0000","last_clean":"2024-09-16T17:05:26.662894+0000","last_became_active":"2024-09-16T16:52:04.660722+0000","last_became_peered":"2024-09-16T16:52:04.660722+0000","last_unstale":"2024-09-16T17:05:26.662894+0000","last_undegraded":"2024-09-16T17:05:26.662894+0000","last_fullsized":"2024-09-16T17:05:26.662894+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.669468+0000","last_change":"2024-09-16T16:52:04.751809+0000","last_active":"2024-09-16T17:05:26.669468+0000","last_peered":"2024-09-16T17:05:26.669468+0000","last_clean":"2024-09-16T17:05:26.669468+0000","last_became_active":"2024-09-16T16:52:04.705911+0000","last_became_peered":"2024-09-16T16:52:04.705911+0000","last_unstale":"2024-09-16T17:05:26.669468+0000","last_undegraded":"2024-09-16T17:05:26.669468+0000","last_fullsized":"2024-09-16T17:05:26.669468+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675979+0000","last_change":"2024-09-16T16:52:04.722993+0000","last_active":"2024-09-16T17:05:26.675979+0000","last_peered":"2024-09-16T17:05:26.675979+0000","last_clean":"2024-09-16T17:05:26.675979+0000","last_became_active":"2024-09-16T16:52:04.711500+0000","last_became_peered":"2024-09-16T16:52:04.711500+0000","last_unstale":"2024-09-16T17:05:26.675979+0000","last_undegraded":"2024-09-16T17:05:26.675979+0000","last_fullsized":"2024-09-16T17:05:26.675979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666810+0000","last_change":"2024-09-16T16:52:04.788750+0000","last_active":"2024-09-16T17:05:26.666810+0000","last_peered":"2024-09-16T17:05:26.666810+0000","last_clean":"2024-09-16T17:05:26.666810+0000","last_became_active":"2024-09-16T16:52:04.784535+0000","last_became_peered":"2024-09-16T16:52:04.784535+0000","last_unstale":"2024-09-16T17:05:26.666810+0000","last_undegraded":"2024-09-16T17:05:26.666810+0000","last_fullsized":"2024-09-16T17:05:26.666810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.680010+0000","last_change":"2024-09-16T16:52:04.746337+0000","last_active":"2024-09-16T17:05:26.680010+0000","last_peered":"2024-09-16T17:05:26.680010+0000","last_clean":"2024-09-16T17:05:26.680010+0000","last_became_active":"2024-09-16T16:52:04.727116+0000","last_became_peered":"2024-09-16T16:52:04.727116+0000","last_unstale":"2024-09-16T17:05:26.680010+0000","last_undegraded":"2024-09-16T17:05:26.680010+0000","last_fullsized":"2024-09-16T17:05:26.680010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.683399+0000","last_change":"2024-09-16T16:52:04.827442+0000","last_active":"2024-09-16T17:05:26.683399+0000","last_peered":"2024-09-16T17:05:26.683399+0000","last_clean":"2024-09-16T17:05:26.683399+0000","last_became_active":"2024-09-16T16:52:04.814429+0000","last_became_peered":"2024-09-16T16:52:04.814429+0000","last_unstale":"2024-09-16T17:05:26.683399+0000","last_undegraded":"2024-09-16T17:05:26.683399+0000","last_fullsized":"2024-09-16T17:05:26.683399+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.681490+0000","last_change":"2024-09-16T16:52:04.730899+0000","last_active":"2024-09-16T17:05:26.681490+0000","last_peered":"2024-09-16T17:05:26.681490+0000","last_clean":"2024-09-16T17:05:26.681490+0000","last_became_active":"2024-09-16T16:52:04.704696+0000","last_became_peered":"2024-09-16T16:52:04.704696+0000","last_unstale":"2024-09-16T17:05:26.681490+0000","last_undegraded":"2024-09-16T17:05:26.681490+0000","last_fullsized":"2024-09-16T17:05:26.681490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.667568+0000","last_change":"2024-09-16T16:52:04.688424+0000","last_active":"2024-09-16T17:05:26.667568+0000","last_peered":"2024-09-16T17:05:26.667568+0000","last_clean":"2024-09-16T17:05:26.667568+0000","last_became_active":"2024-09-16T16:52:04.668455+0000","last_became_peered":"2024-09-16T16:52:04.668455+0000","last_unstale":"2024-09-16T17:05:26.667568+0000","last_undegraded":"2024-09-16T17:05:26.667568+0000","last_fullsized":"2024-09-16T17:05:26.667568+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.660886+0000","last_change":"2024-09-16T16:52:04.664921+0000","last_active":"2024-09-16T17:05:26.660886+0000","last_peered":"2024-09-16T17:05:26.660886+0000","last_clean":"2024-09-16T17:05:26.660886+0000","last_became_active":"2024-09-16T16:52:04.647610+0000","last_became_peered":"2024-09-16T16:52:04.647610+0000","last_unstale":"2024-09-16T17:05:26.660886+0000","last_undegraded":"2024-09-16T17:05:26.660886+0000","last_fullsized":"2024-09-16T17:05:26.660886+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.677430+0000","last_change":"2024-09-16T16:52:04.763162+0000","last_active":"2024-09-16T17:05:26.677430+0000","last_peered":"2024-09-16T17:05:26.677430+0000","last_clean":"2024-09-16T17:05:26.677430+0000","last_became_active":"2024-09-16T16:52:04.755722+0000","last_became_peered":"2024-09-16T16:52:04.755722+0000","last_unstale":"2024-09-16T17:05:26.677430+0000","last_undegraded":"2024-09-16T17:05:26.677430+0000","last_fullsized":"2024-09-16T17:05:26.677430+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.682275+0000","last_change":"2024-09-16T16:52:04.797949+0000","last_active":"2024-09-16T17:05:26.682275+0000","last_peered":"2024-09-16T17:05:26.682275+0000","last_clean":"2024-09-16T17:05:26.682275+0000","last_became_active":"2024-09-16T16:52:04.791745+0000","last_became_peered":"2024-09-16T16:52:04.791745+0000","last_unstale":"2024-09-16T17:05:26.682275+0000","last_undegraded":"2024-09-16T17:05:26.682275+0000","last_fullsized":"2024-09-16T17:05:26.682275+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.670799+0000","last_change":"2024-09-16T16:52:04.698664+0000","last_active":"2024-09-16T17:05:26.670799+0000","last_peered":"2024-09-16T17:05:26.670799+0000","last_clean":"2024-09-16T17:05:26.670799+0000","last_became_active":"2024-09-16T16:52:04.686232+0000","last_became_peered":"2024-09-16T16:52:04.686232+0000","last_unstale":"2024-09-16T17:05:26.670799+0000","last_undegraded":"2024-09-16T17:05:26.670799+0000","last_fullsized":"2024-09-16T17:05:26.670799+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.668344+0000","last_change":"2024-09-16T16:52:04.682117+0000","last_active":"2024-09-16T17:05:26.668344+0000","last_peered":"2024-09-16T17:05:26.668344+0000","last_clean":"2024-09-16T17:05:26.668344+0000","last_became_active":"2024-09-16T16:52:04.674267+0000","last_became_peered":"2024-09-16T16:52:04.674267+0000","last_unstale":"2024-09-16T17:05:26.668344+0000","last_undegraded":"2024-09-16T17:05:26.668344+0000","last_fullsized":"2024-09-16T17:05:26.668344+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666035+0000","last_change":"2024-09-16T16:52:04.678055+0000","last_active":"2024-09-16T17:05:26.666035+0000","last_peered":"2024-09-16T17:05:26.666035+0000","last_clean":"2024-09-16T17:05:26.666035+0000","last_became_active":"2024-09-16T16:52:04.651245+0000","last_became_peered":"2024-09-16T16:52:04.651245+0000","last_unstale":"2024-09-16T17:05:26.666035+0000","last_undegraded":"2024-09-16T17:05:26.666035+0000","last_fullsized":"2024-09-16T17:05:26.666035+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675175+0000","last_change":"2024-09-16T16:52:04.725681+0000","last_active":"2024-09-16T17:05:26.675175+0000","last_peered":"2024-09-16T17:05:26.675175+0000","last_clean":"2024-09-16T17:05:26.675175+0000","last_became_active":"2024-09-16T16:52:04.716567+0000","last_became_peered":"2024-09-16T16:52:04.716567+0000","last_unstale":"2024-09-16T17:05:26.675175+0000","last_undegraded":"2024-09-16T17:05:26.675175+0000","last_fullsized":"2024-09-16T17:05:26.675175+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.673985+0000","last_change":"2024-09-16T16:52:04.848189+0000","last_active":"2024-09-16T17:05:26.673985+0000","last_peered":"2024-09-16T17:05:26.673985+0000","last_clean":"2024-09-16T17:05:26.673985+0000","last_became_active":"2024-09-16T16:52:04.840298+0000","last_became_peered":"2024-09-16T16:52:04.840298+0000","last_unstale":"2024-09-16T17:05:26.673985+0000","last_undegraded":"2024-09-16T17:05:26.673985+0000","last_fullsized":"2024-09-16T17:05:26.673985+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675782+0000","last_change":"2024-09-16T16:52:04.756769+0000","last_active":"2024-09-16T17:05:26.675782+0000","last_peered":"2024-09-16T17:05:26.675782+0000","last_clean":"2024-09-16T17:05:26.675782+0000","last_became_active":"2024-09-16T16:52:04.751100+0000","last_became_peered":"2024-09-16T16:52:04.751100+0000","last_unstale":"2024-09-16T17:05:26.675782+0000","last_undegraded":"2024-09-16T17:05:26.675782+0000","last_fullsized":"2024-09-16T17:05:26.675782+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675237+0000","last_change":"2024-09-16T16:52:04.797030+0000","last_active":"2024-09-16T17:05:26.675237+0000","last_peered":"2024-09-16T17:05:26.675237+0000","last_clean":"2024-09-16T17:05:26.675237+0000","last_became_active":"2024-09-16T16:52:04.789190+0000","last_became_peered":"2024-09-16T16:52:04.789190+0000","last_unstale":"2024-09-16T17:05:26.675237+0000","last_undegraded":"2024-09-16T17:05:26.675237+0000","last_fullsized":"2024-09-16T17:05:26.675237+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.680503+0000","last_change":"2024-09-16T16:52:04.818516+0000","last_active":"2024-09-16T17:05:26.680503+0000","last_peered":"2024-09-16T17:05:26.680503+0000","last_clean":"2024-09-16T17:05:26.680503+0000","last_became_active":"2024-09-16T16:52:04.805951+0000","last_became_peered":"2024-09-16T16:52:04.805951+0000","last_unstale":"2024-09-16T17:05:26.680503+0000","last_undegraded":"2024-09-16T17:05:26.680503+0000","last_fullsized":"2024-09-16T17:05:26.680503+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666880+0000","last_change":"2024-09-16T16:52:04.747686+0000","last_active":"2024-09-16T17:05:26.666880+0000","last_peered":"2024-09-16T17:05:26.666880+0000","last_clean":"2024-09-16T17:05:26.666880+0000","last_became_active":"2024-09-16T16:52:04.711856+0000","last_became_peered":"2024-09-16T16:52:04.711856+0000","last_unstale":"2024-09-16T17:05:26.666880+0000","last_undegraded":"2024-09-16T17:05:26.666880+0000","last_fullsized":"2024-09-16T17:05:26.666880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1476,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.686366+0000","last_change":"2024-09-16T16:52:04.693250+0000","last_active":"2024-09-16T17:05:26.686366+0000","last_peered":"2024-09-16T17:05:26.686366+0000","last_clean":"2024-09-16T17:05:26.686366+0000","last_became_active":"2024-09-16T16:52:04.671009+0000","last_became_peered":"2024-09-16T16:52:04.671009+0000","last_unstale":"2024-09-16T17:05:26.686366+0000","last_undegraded":"2024-09-16T17:05:26.686366+0000","last_fullsized":"2024-09-16T17:05:26.686366+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.674375+0000","last_change":"2024-09-16T16:52:04.674154+0000","last_active":"2024-09-16T17:05:26.674375+0000","last_peered":"2024-09-16T17:05:26.674375+0000","last_clean":"2024-09-16T17:05:26.674375+0000","last_became_active":"2024-09-16T16:52:04.662483+0000","last_became_peered":"2024-09-16T16:52:04.662483+0000","last_unstale":"2024-09-16T17:05:26.674375+0000","last_undegraded":"2024-09-16T17:05:26.674375+0000","last_fullsized":"2024-09-16T17:05:26.674375+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.672010+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T17:05:26.672010+0000","last_peered":"2024-09-16T17:05:26.672010+0000","last_clean":"2024-09-16T17:05:26.672010+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T17:05:26.672010+0000","last_undegraded":"2024-09-16T17:05:26.672010+0000","last_fullsized":"2024-09-16T17:05:26.672010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.678575+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T17:05:26.678575+0000","last_peered":"2024-09-16T17:05:26.678575+0000","last_clean":"2024-09-16T17:05:26.678575+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T17:05:26.678575+0000","last_undegraded":"2024-09-16T17:05:26.678575+0000","last_fullsized":"2024-09-16T17:05:26.678575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675054+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T17:05:26.675054+0000","last_peered":"2024-09-16T17:05:26.675054+0000","last_clean":"2024-09-16T17:05:26.675054+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T17:05:26.675054+0000","last_undegraded":"2024-09-16T17:05:26.675054+0000","last_fullsized":"2024-09-16T17:05:26.675054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.658592+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T17:05:26.658592+0000","last_peered":"2024-09-16T17:05:26.658592+0000","last_clean":"2024-09-16T17:05:26.658592+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T17:05:26.658592+0000","last_undegraded":"2024-09-16T17:05:26.658592+0000","last_fullsized":"2024-09-16T17:05:26.658592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.682734+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T17:05:26.682734+0000","last_peered":"2024-09-16T17:05:26.682734+0000","last_clean":"2024-09-16T17:05:26.682734+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T17:05:26.682734+0000","last_undegraded":"2024-09-16T17:05:26.682734+0000","last_fullsized":"2024-09-16T17:05:26.682734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.671332+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T17:05:26.671332+0000","last_peered":"2024-09-16T17:05:26.671332+0000","last_clean":"2024-09-16T17:05:26.671332+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T17:05:26.671332+0000","last_undegraded":"2024-09-16T17:05:26.671332+0000","last_fullsized":"2024-09-16T17:05:26.671332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.678519+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T17:05:26.678519+0000","last_peered":"2024-09-16T17:05:26.678519+0000","last_clean":"2024-09-16T17:05:26.678519+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T17:05:26.678519+0000","last_undegraded":"2024-09-16T17:05:26.678519+0000","last_fullsized":"2024-09-16T17:05:26.678519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.685172+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T17:05:26.685172+0000","last_peered":"2024-09-16T17:05:26.685172+0000","last_clean":"2024-09-16T17:05:26.685172+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T17:05:26.685172+0000","last_undegraded":"2024-09-16T17:05:26.685172+0000","last_fullsized":"2024-09-16T17:05:26.685172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2205,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.664688+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T17:05:26.664688+0000","last_peered":"2024-09-16T17:05:26.664688+0000","last_clean":"2024-09-16T17:05:26.664688+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T17:05:26.664688+0000","last_undegraded":"2024-09-16T17:05:26.664688+0000","last_fullsized":"2024-09-16T17:05:26.664688+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70696,"kb_used_data":3608,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301144,"statfs":{"total":96636764160,"available":96564371456,"internally_reserved":0,"allocated":3694592,"data_stored":2096368,"data_compressed":106587,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66472,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305368,"statfs":{"total":96636764160,"available":96568696832,"internally_reserved":0,"allocated":3629056,"data_stored":1493149,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65048,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306792,"statfs":{"total":96636764160,"available":96570155008,"internally_reserved":0,"allocated":3612672,"data_stored":1480255,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":2109262,"data_compressed":112475,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:05:59.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T17:05:59.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:05:59.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.536+0000 7ff9674d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:59.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.541+0000 7ff9674d1640 1 Processor -- start 2024-09-16T17:05:59.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.542+0000 7ff9674d1640 1 -- start start 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff9674d1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff96009f040 0x7ff960068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff9674d1640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96006d370 con 0x7ff96009e910 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff9674d1640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff960070cb0 con 0x7ff96009f040 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff96526d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff96009f040 0x7ff960068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff96526d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff96009f040 0x7ff960068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36854/0 (socket says 172.21.15.59:36854) 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff96526d640 1 -- 172.21.15.59:0/3656192266 learned_addr learned my addr 172.21.15.59:0/3656192266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.543+0000 7ff964a6c640 1 --1- 172.21.15.59:0/3656192266 >> v1:172.21.15.59:6789/0 conn(0x7ff96009e910 0x7ff960069280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52344/0 (socket says 172.21.15.59:52344) 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff96526d640 1 -- 172.21.15.59:0/3656192266 >> v1:172.21.15.59:6789/0 conn(0x7ff96009e910 legacy=0x7ff960069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff96526d640 1 -- 172.21.15.59:0/3656192266 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96009c1c0 con 0x7ff96009f040 2024-09-16T17:05:59.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff957fff640 1 -- 172.21.15.59:0/3656192266 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089232135 0 0) 0x7ff96006d370 con 0x7ff96009e910 2024-09-16T17:05:59.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff96526d640 1 --2- 172.21.15.59:0/3656192266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009f040 0x7ff960068d40 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54152a5322f0965 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff957fff640 1 -- 172.21.15.59:0/3656192266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff95c009e50 con 0x7ff96009f040 2024-09-16T17:05:59.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff957fff640 1 -- 172.21.15.59:0/3656192266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff95c00e230 con 0x7ff96009f040 2024-09-16T17:05:59.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.544+0000 7ff957fff640 1 -- 172.21.15.59:0/3656192266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff95c00e4d0 con 0x7ff96009f040 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 -- 172.21.15.59:0/3656192266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009f040 msgr2=0x7ff960068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 --2- 172.21.15.59:0/3656192266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009f040 0x7ff960068d40 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 -- 172.21.15.59:0/3656192266 shutdown_connections 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 --2- 172.21.15.59:0/3656192266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009f040 0x7ff960068d40 unknown :-1 s=CLOSED pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 -- 172.21.15.59:0/3656192266 >> 172.21.15.59:0/3656192266 conn(0x7ff9600a32a0 msgr2=0x7ff9600a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 -- 172.21.15.59:0/3656192266 shutdown_connections 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 1 -- 172.21.15.59:0/3656192266 wait complete. 2024-09-16T17:05:59.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.545+0000 7ff9674d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:59.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.547+0000 7ff9674d1640 1 Processor -- start 2024-09-16T17:05:59.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.547+0000 7ff9674d1640 1 -- start start 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.548+0000 7ff9674d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 0x7ff9601383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.548+0000 7ff9674d1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff96009bc90 con 0x7ff96009e910 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.548+0000 7ff96526d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 0x7ff9601383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.548+0000 7ff96526d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 0x7ff9601383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36856/0 (socket says 172.21.15.59:36856) 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.548+0000 7ff96526d640 1 -- 172.21.15.59:0/2294013919 learned_addr learned my addr 172.21.15.59:0/2294013919 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff96526d640 1 -- 172.21.15.59:0/2294013919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9600716e0 con 0x7ff96009e910 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff96526d640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 0x7ff9601383a0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff95c00ee10 con 0x7ff96009e910 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff95c015420 con 0x7ff96009e910 2024-09-16T17:05:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff95c0156c0 con 0x7ff96009e910 2024-09-16T17:05:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff960099c60 con 0x7ff96009e910 2024-09-16T17:05:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.549+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff960097a00 con 0x7ff96009e910 2024-09-16T17:05:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.550+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff95c015870 con 0x7ff96009e910 2024-09-16T17:05:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.550+0000 7ff955ffb640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff94403e930 0x7ff944040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.550+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7ff95c051000 con 0x7ff96009e910 2024-09-16T17:05:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.550+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff960068d40 con 0x7ff96009e910 2024-09-16T17:05:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.551+0000 7ff964a6c640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff94403e930 0x7ff944040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.551+0000 7ff964a6c640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff94403e930 0x7ff944040e40 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.556+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff95c014c60 con 0x7ff96009e910 2024-09-16T17:05:59.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.738+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff960072680 con 0x7ff94403e930 2024-09-16T17:05:59.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.741+0000 7ff955ffb640 1 -- 172.21.15.59:0/2294013919 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109238 (crc 0 0 0) 0x7ff950001270 con 0x7ff94403e930 2024-09-16T17:05:59.743 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:05:59.743 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T17:05:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff94403e930 msgr2=0x7ff944040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff94403e930 0x7ff944040e40 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 msgr2=0x7ff9601383a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 0x7ff9601383a0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 shutdown_connections 2024-09-16T17:05:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7ff94403e930 0x7ff944040e40 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 --2- 172.21.15.59:0/2294013919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff96009e910 0x7ff9601383a0 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 >> 172.21.15.59:0/2294013919 conn(0x7ff9600a32a0 msgr2=0x7ff960072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 shutdown_connections 2024-09-16T17:05:59.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.744+0000 7ff9674d1640 1 -- 172.21.15.59:0/2294013919 wait complete. 2024-09-16T17:05:59.757 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":1286,"stamp":"2024-09-16T17:05:58.045921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":263200,"kb_used_data":14304,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377224160,"statfs":{"total":386547056640,"available":386277539840,"internally_reserved":0,"allocated":14647296,"data_stored":7179034,"data_compressed":354486,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.068518"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.679314+0000","last_change":"2024-09-16T16:52:04.699706+0000","last_active":"2024-09-16T17:05:26.679314+0000","last_peered":"2024-09-16T17:05:26.679314+0000","last_clean":"2024-09-16T17:05:26.679314+0000","last_became_active":"2024-09-16T16:52:04.683267+0000","last_became_peered":"2024-09-16T16:52:04.683267+0000","last_unstale":"2024-09-16T17:05:26.679314+0000","last_undegraded":"2024-09-16T17:05:26.679314+0000","last_fullsized":"2024-09-16T17:05:26.679314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.685412+0000","last_change":"2024-09-16T16:52:04.761758+0000","last_active":"2024-09-16T17:05:26.685412+0000","last_peered":"2024-09-16T17:05:26.685412+0000","last_clean":"2024-09-16T17:05:26.685412+0000","last_became_active":"2024-09-16T16:52:04.744118+0000","last_became_peered":"2024-09-16T16:52:04.744118+0000","last_unstale":"2024-09-16T17:05:26.685412+0000","last_undegraded":"2024-09-16T17:05:26.685412+0000","last_fullsized":"2024-09-16T17:05:26.685412+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.667865+0000","last_change":"2024-09-16T16:52:04.668513+0000","last_active":"2024-09-16T17:05:26.667865+0000","last_peered":"2024-09-16T17:05:26.667865+0000","last_clean":"2024-09-16T17:05:26.667865+0000","last_became_active":"2024-09-16T16:52:04.659260+0000","last_became_peered":"2024-09-16T16:52:04.659260+0000","last_unstale":"2024-09-16T17:05:26.667865+0000","last_undegraded":"2024-09-16T17:05:26.667865+0000","last_fullsized":"2024-09-16T17:05:26.667865+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666497+0000","last_change":"2024-09-16T16:52:04.720609+0000","last_active":"2024-09-16T17:05:26.666497+0000","last_peered":"2024-09-16T17:05:26.666497+0000","last_clean":"2024-09-16T17:05:26.666497+0000","last_became_active":"2024-09-16T16:52:04.707958+0000","last_became_peered":"2024-09-16T16:52:04.707958+0000","last_unstale":"2024-09-16T17:05:26.666497+0000","last_undegraded":"2024-09-16T17:05:26.666497+0000","last_fullsized":"2024-09-16T17:05:26.666497+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.669945+0000","last_change":"2024-09-16T16:52:04.663528+0000","last_active":"2024-09-16T17:05:26.669945+0000","last_peered":"2024-09-16T17:05:26.669945+0000","last_clean":"2024-09-16T17:05:26.669945+0000","last_became_active":"2024-09-16T16:52:04.655240+0000","last_became_peered":"2024-09-16T16:52:04.655240+0000","last_unstale":"2024-09-16T17:05:26.669945+0000","last_undegraded":"2024-09-16T17:05:26.669945+0000","last_fullsized":"2024-09-16T17:05:26.669945+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.672028+0000","last_change":"2024-09-16T16:52:04.673009+0000","last_active":"2024-09-16T17:05:26.672028+0000","last_peered":"2024-09-16T17:05:26.672028+0000","last_clean":"2024-09-16T17:05:26.672028+0000","last_became_active":"2024-09-16T16:52:04.655040+0000","last_became_peered":"2024-09-16T16:52:04.655040+0000","last_unstale":"2024-09-16T17:05:26.672028+0000","last_undegraded":"2024-09-16T17:05:26.672028+0000","last_fullsized":"2024-09-16T17:05:26.672028+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.679148+0000","last_change":"2024-09-16T16:52:04.834460+0000","last_active":"2024-09-16T17:05:26.679148+0000","last_peered":"2024-09-16T17:05:26.679148+0000","last_clean":"2024-09-16T17:05:26.679148+0000","last_became_active":"2024-09-16T16:52:04.822727+0000","last_became_peered":"2024-09-16T16:52:04.822727+0000","last_unstale":"2024-09-16T17:05:26.679148+0000","last_undegraded":"2024-09-16T17:05:26.679148+0000","last_fullsized":"2024-09-16T17:05:26.679148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.684928+0000","last_change":"2024-09-16T16:52:04.766288+0000","last_active":"2024-09-16T17:05:26.684928+0000","last_peered":"2024-09-16T17:05:26.684928+0000","last_clean":"2024-09-16T17:05:26.684928+0000","last_became_active":"2024-09-16T16:52:04.749230+0000","last_became_peered":"2024-09-16T16:52:04.749230+0000","last_unstale":"2024-09-16T17:05:26.684928+0000","last_undegraded":"2024-09-16T17:05:26.684928+0000","last_fullsized":"2024-09-16T17:05:26.684928+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.668759+0000","last_change":"2024-09-16T16:52:04.733335+0000","last_active":"2024-09-16T17:05:26.668759+0000","last_peered":"2024-09-16T17:05:26.668759+0000","last_clean":"2024-09-16T17:05:26.668759+0000","last_became_active":"2024-09-16T16:52:04.722821+0000","last_became_peered":"2024-09-16T16:52:04.722821+0000","last_unstale":"2024-09-16T17:05:26.668759+0000","last_undegraded":"2024-09-16T17:05:26.668759+0000","last_fullsized":"2024-09-16T17:05:26.668759+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.662354+0000","last_change":"2024-09-16T16:52:04.641248+0000","last_active":"2024-09-16T17:05:26.662354+0000","last_peered":"2024-09-16T17:05:26.662354+0000","last_clean":"2024-09-16T17:05:26.662354+0000","last_became_active":"2024-09-16T16:52:04.628000+0000","last_became_peered":"2024-09-16T16:52:04.628000+0000","last_unstale":"2024-09-16T17:05:26.662354+0000","last_undegraded":"2024-09-16T17:05:26.662354+0000","last_fullsized":"2024-09-16T17:05:26.662354+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.662894+0000","last_change":"2024-09-16T16:52:04.684071+0000","last_active":"2024-09-16T17:05:26.662894+0000","last_peered":"2024-09-16T17:05:26.662894+0000","last_clean":"2024-09-16T17:05:26.662894+0000","last_became_active":"2024-09-16T16:52:04.660722+0000","last_became_peered":"2024-09-16T16:52:04.660722+0000","last_unstale":"2024-09-16T17:05:26.662894+0000","last_undegraded":"2024-09-16T17:05:26.662894+0000","last_fullsized":"2024-09-16T17:05:26.662894+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.669468+0000","last_change":"2024-09-16T16:52:04.751809+0000","last_active":"2024-09-16T17:05:26.669468+0000","last_peered":"2024-09-16T17:05:26.669468+0000","last_clean":"2024-09-16T17:05:26.669468+0000","last_became_active":"2024-09-16T16:52:04.705911+0000","last_became_peered":"2024-09-16T16:52:04.705911+0000","last_unstale":"2024-09-16T17:05:26.669468+0000","last_undegraded":"2024-09-16T17:05:26.669468+0000","last_fullsized":"2024-09-16T17:05:26.669468+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675979+0000","last_change":"2024-09-16T16:52:04.722993+0000","last_active":"2024-09-16T17:05:26.675979+0000","last_peered":"2024-09-16T17:05:26.675979+0000","last_clean":"2024-09-16T17:05:26.675979+0000","last_became_active":"2024-09-16T16:52:04.711500+0000","last_became_peered":"2024-09-16T16:52:04.711500+0000","last_unstale":"2024-09-16T17:05:26.675979+0000","last_undegraded":"2024-09-16T17:05:26.675979+0000","last_fullsized":"2024-09-16T17:05:26.675979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666810+0000","last_change":"2024-09-16T16:52:04.788750+0000","last_active":"2024-09-16T17:05:26.666810+0000","last_peered":"2024-09-16T17:05:26.666810+0000","last_clean":"2024-09-16T17:05:26.666810+0000","last_became_active":"2024-09-16T16:52:04.784535+0000","last_became_peered":"2024-09-16T16:52:04.784535+0000","last_unstale":"2024-09-16T17:05:26.666810+0000","last_undegraded":"2024-09-16T17:05:26.666810+0000","last_fullsized":"2024-09-16T17:05:26.666810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.680010+0000","last_change":"2024-09-16T16:52:04.746337+0000","last_active":"2024-09-16T17:05:26.680010+0000","last_peered":"2024-09-16T17:05:26.680010+0000","last_clean":"2024-09-16T17:05:26.680010+0000","last_became_active":"2024-09-16T16:52:04.727116+0000","last_became_peered":"2024-09-16T16:52:04.727116+0000","last_unstale":"2024-09-16T17:05:26.680010+0000","last_undegraded":"2024-09-16T17:05:26.680010+0000","last_fullsized":"2024-09-16T17:05:26.680010+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.683399+0000","last_change":"2024-09-16T16:52:04.827442+0000","last_active":"2024-09-16T17:05:26.683399+0000","last_peered":"2024-09-16T17:05:26.683399+0000","last_clean":"2024-09-16T17:05:26.683399+0000","last_became_active":"2024-09-16T16:52:04.814429+0000","last_became_peered":"2024-09-16T16:52:04.814429+0000","last_unstale":"2024-09-16T17:05:26.683399+0000","last_undegraded":"2024-09-16T17:05:26.683399+0000","last_fullsized":"2024-09-16T17:05:26.683399+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.681490+0000","last_change":"2024-09-16T16:52:04.730899+0000","last_active":"2024-09-16T17:05:26.681490+0000","last_peered":"2024-09-16T17:05:26.681490+0000","last_clean":"2024-09-16T17:05:26.681490+0000","last_became_active":"2024-09-16T16:52:04.704696+0000","last_became_peered":"2024-09-16T16:52:04.704696+0000","last_unstale":"2024-09-16T17:05:26.681490+0000","last_undegraded":"2024-09-16T17:05:26.681490+0000","last_fullsized":"2024-09-16T17:05:26.681490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.667568+0000","last_change":"2024-09-16T16:52:04.688424+0000","last_active":"2024-09-16T17:05:26.667568+0000","last_peered":"2024-09-16T17:05:26.667568+0000","last_clean":"2024-09-16T17:05:26.667568+0000","last_became_active":"2024-09-16T16:52:04.668455+0000","last_became_peered":"2024-09-16T16:52:04.668455+0000","last_unstale":"2024-09-16T17:05:26.667568+0000","last_undegraded":"2024-09-16T17:05:26.667568+0000","last_fullsized":"2024-09-16T17:05:26.667568+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.660886+0000","last_change":"2024-09-16T16:52:04.664921+0000","last_active":"2024-09-16T17:05:26.660886+0000","last_peered":"2024-09-16T17:05:26.660886+0000","last_clean":"2024-09-16T17:05:26.660886+0000","last_became_active":"2024-09-16T16:52:04.647610+0000","last_became_peered":"2024-09-16T16:52:04.647610+0000","last_unstale":"2024-09-16T17:05:26.660886+0000","last_undegraded":"2024-09-16T17:05:26.660886+0000","last_fullsized":"2024-09-16T17:05:26.660886+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.677430+0000","last_change":"2024-09-16T16:52:04.763162+0000","last_active":"2024-09-16T17:05:26.677430+0000","last_peered":"2024-09-16T17:05:26.677430+0000","last_clean":"2024-09-16T17:05:26.677430+0000","last_became_active":"2024-09-16T16:52:04.755722+0000","last_became_peered":"2024-09-16T16:52:04.755722+0000","last_unstale":"2024-09-16T17:05:26.677430+0000","last_undegraded":"2024-09-16T17:05:26.677430+0000","last_fullsized":"2024-09-16T17:05:26.677430+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.682275+0000","last_change":"2024-09-16T16:52:04.797949+0000","last_active":"2024-09-16T17:05:26.682275+0000","last_peered":"2024-09-16T17:05:26.682275+0000","last_clean":"2024-09-16T17:05:26.682275+0000","last_became_active":"2024-09-16T16:52:04.791745+0000","last_became_peered":"2024-09-16T16:52:04.791745+0000","last_unstale":"2024-09-16T17:05:26.682275+0000","last_undegraded":"2024-09-16T17:05:26.682275+0000","last_fullsized":"2024-09-16T17:05:26.682275+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.670799+0000","last_change":"2024-09-16T16:52:04.698664+0000","last_active":"2024-09-16T17:05:26.670799+0000","last_peered":"2024-09-16T17:05:26.670799+0000","last_clean":"2024-09-16T17:05:26.670799+0000","last_became_active":"2024-09-16T16:52:04.686232+0000","last_became_peered":"2024-09-16T16:52:04.686232+0000","last_unstale":"2024-09-16T17:05:26.670799+0000","last_undegraded":"2024-09-16T17:05:26.670799+0000","last_fullsized":"2024-09-16T17:05:26.670799+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.668344+0000","last_change":"2024-09-16T16:52:04.682117+0000","last_active":"2024-09-16T17:05:26.668344+0000","last_peered":"2024-09-16T17:05:26.668344+0000","last_clean":"2024-09-16T17:05:26.668344+0000","last_became_active":"2024-09-16T16:52:04.674267+0000","last_became_peered":"2024-09-16T16:52:04.674267+0000","last_unstale":"2024-09-16T17:05:26.668344+0000","last_undegraded":"2024-09-16T17:05:26.668344+0000","last_fullsized":"2024-09-16T17:05:26.668344+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666035+0000","last_change":"2024-09-16T16:52:04.678055+0000","last_active":"2024-09-16T17:05:26.666035+0000","last_peered":"2024-09-16T17:05:26.666035+0000","last_clean":"2024-09-16T17:05:26.666035+0000","last_became_active":"2024-09-16T16:52:04.651245+0000","last_became_peered":"2024-09-16T16:52:04.651245+0000","last_unstale":"2024-09-16T17:05:26.666035+0000","last_undegraded":"2024-09-16T17:05:26.666035+0000","last_fullsized":"2024-09-16T17:05:26.666035+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675175+0000","last_change":"2024-09-16T16:52:04.725681+0000","last_active":"2024-09-16T17:05:26.675175+0000","last_peered":"2024-09-16T17:05:26.675175+0000","last_clean":"2024-09-16T17:05:26.675175+0000","last_became_active":"2024-09-16T16:52:04.716567+0000","last_became_peered":"2024-09-16T16:52:04.716567+0000","last_unstale":"2024-09-16T17:05:26.675175+0000","last_undegraded":"2024-09-16T17:05:26.675175+0000","last_fullsized":"2024-09-16T17:05:26.675175+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.673985+0000","last_change":"2024-09-16T16:52:04.848189+0000","last_active":"2024-09-16T17:05:26.673985+0000","last_peered":"2024-09-16T17:05:26.673985+0000","last_clean":"2024-09-16T17:05:26.673985+0000","last_became_active":"2024-09-16T16:52:04.840298+0000","last_became_peered":"2024-09-16T16:52:04.840298+0000","last_unstale":"2024-09-16T17:05:26.673985+0000","last_undegraded":"2024-09-16T17:05:26.673985+0000","last_fullsized":"2024-09-16T17:05:26.673985+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675782+0000","last_change":"2024-09-16T16:52:04.756769+0000","last_active":"2024-09-16T17:05:26.675782+0000","last_peered":"2024-09-16T17:05:26.675782+0000","last_clean":"2024-09-16T17:05:26.675782+0000","last_became_active":"2024-09-16T16:52:04.751100+0000","last_became_peered":"2024-09-16T16:52:04.751100+0000","last_unstale":"2024-09-16T17:05:26.675782+0000","last_undegraded":"2024-09-16T17:05:26.675782+0000","last_fullsized":"2024-09-16T17:05:26.675782+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675237+0000","last_change":"2024-09-16T16:52:04.797030+0000","last_active":"2024-09-16T17:05:26.675237+0000","last_peered":"2024-09-16T17:05:26.675237+0000","last_clean":"2024-09-16T17:05:26.675237+0000","last_became_active":"2024-09-16T16:52:04.789190+0000","last_became_peered":"2024-09-16T16:52:04.789190+0000","last_unstale":"2024-09-16T17:05:26.675237+0000","last_undegraded":"2024-09-16T17:05:26.675237+0000","last_fullsized":"2024-09-16T17:05:26.675237+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.680503+0000","last_change":"2024-09-16T16:52:04.818516+0000","last_active":"2024-09-16T17:05:26.680503+0000","last_peered":"2024-09-16T17:05:26.680503+0000","last_clean":"2024-09-16T17:05:26.680503+0000","last_became_active":"2024-09-16T16:52:04.805951+0000","last_became_peered":"2024-09-16T16:52:04.805951+0000","last_unstale":"2024-09-16T17:05:26.680503+0000","last_undegraded":"2024-09-16T17:05:26.680503+0000","last_fullsized":"2024-09-16T17:05:26.680503+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.666880+0000","last_change":"2024-09-16T16:52:04.747686+0000","last_active":"2024-09-16T17:05:26.666880+0000","last_peered":"2024-09-16T17:05:26.666880+0000","last_clean":"2024-09-16T17:05:26.666880+0000","last_became_active":"2024-09-16T16:52:04.711856+0000","last_became_peered":"2024-09-16T16:52:04.711856+0000","last_unstale":"2024-09-16T17:05:26.666880+0000","last_undegraded":"2024-09-16T17:05:26.666880+0000","last_fullsized":"2024-09-16T17:05:26.666880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1476,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.686366+0000","last_change":"2024-09-16T16:52:04.693250+0000","last_active":"2024-09-16T17:05:26.686366+0000","last_peered":"2024-09-16T17:05:26.686366+0000","last_clean":"2024-09-16T17:05:26.686366+0000","last_became_active":"2024-09-16T16:52:04.671009+0000","last_became_peered":"2024-09-16T16:52:04.671009+0000","last_unstale":"2024-09-16T17:05:26.686366+0000","last_undegraded":"2024-09-16T17:05:26.686366+0000","last_fullsized":"2024-09-16T17:05:26.686366+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1463,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.674375+0000","last_change":"2024-09-16T16:52:04.674154+0000","last_active":"2024-09-16T17:05:26.674375+0000","last_peered":"2024-09-16T17:05:26.674375+0000","last_clean":"2024-09-16T17:05:26.674375+0000","last_became_active":"2024-09-16T16:52:04.662483+0000","last_became_peered":"2024-09-16T16:52:04.662483+0000","last_unstale":"2024-09-16T17:05:26.674375+0000","last_undegraded":"2024-09-16T17:05:26.674375+0000","last_fullsized":"2024-09-16T17:05:26.674375+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.672010+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T17:05:26.672010+0000","last_peered":"2024-09-16T17:05:26.672010+0000","last_clean":"2024-09-16T17:05:26.672010+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T17:05:26.672010+0000","last_undegraded":"2024-09-16T17:05:26.672010+0000","last_fullsized":"2024-09-16T17:05:26.672010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.678575+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T17:05:26.678575+0000","last_peered":"2024-09-16T17:05:26.678575+0000","last_clean":"2024-09-16T17:05:26.678575+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T17:05:26.678575+0000","last_undegraded":"2024-09-16T17:05:26.678575+0000","last_fullsized":"2024-09-16T17:05:26.678575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.675054+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T17:05:26.675054+0000","last_peered":"2024-09-16T17:05:26.675054+0000","last_clean":"2024-09-16T17:05:26.675054+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T17:05:26.675054+0000","last_undegraded":"2024-09-16T17:05:26.675054+0000","last_fullsized":"2024-09-16T17:05:26.675054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.658592+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T17:05:26.658592+0000","last_peered":"2024-09-16T17:05:26.658592+0000","last_clean":"2024-09-16T17:05:26.658592+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T17:05:26.658592+0000","last_undegraded":"2024-09-16T17:05:26.658592+0000","last_fullsized":"2024-09-16T17:05:26.658592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.682734+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T17:05:26.682734+0000","last_peered":"2024-09-16T17:05:26.682734+0000","last_clean":"2024-09-16T17:05:26.682734+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T17:05:26.682734+0000","last_undegraded":"2024-09-16T17:05:26.682734+0000","last_fullsized":"2024-09-16T17:05:26.682734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.671332+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T17:05:26.671332+0000","last_peered":"2024-09-16T17:05:26.671332+0000","last_clean":"2024-09-16T17:05:26.671332+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T17:05:26.671332+0000","last_undegraded":"2024-09-16T17:05:26.671332+0000","last_fullsized":"2024-09-16T17:05:26.671332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.678519+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T17:05:26.678519+0000","last_peered":"2024-09-16T17:05:26.678519+0000","last_clean":"2024-09-16T17:05:26.678519+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T17:05:26.678519+0000","last_undegraded":"2024-09-16T17:05:26.678519+0000","last_fullsized":"2024-09-16T17:05:26.678519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.685172+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T17:05:26.685172+0000","last_peered":"2024-09-16T17:05:26.685172+0000","last_clean":"2024-09-16T17:05:26.685172+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T17:05:26.685172+0000","last_undegraded":"2024-09-16T17:05:26.685172+0000","last_fullsized":"2024-09-16T17:05:26.685172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2205,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T17:05:26.664688+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T17:05:26.664688+0000","last_peered":"2024-09-16T17:05:26.664688+0000","last_clean":"2024-09-16T17:05:26.664688+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T17:05:26.664688+0000","last_undegraded":"2024-09-16T17:05:26.664688+0000","last_fullsized":"2024-09-16T17:05:26.664688+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70696,"kb_used_data":3608,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301144,"statfs":{"total":96636764160,"available":96564371456,"internally_reserved":0,"allocated":3694592,"data_stored":2096368,"data_compressed":106587,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66472,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305368,"statfs":{"total":96636764160,"available":96568696832,"internally_reserved":0,"allocated":3629056,"data_stored":1493149,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65048,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306792,"statfs":{"total":96636764160,"available":96570155008,"internally_reserved":0,"allocated":3612672,"data_stored":1480255,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":2109262,"data_compressed":112475,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:05:59.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:05:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.868+0000 7fd1f3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.873+0000 7fd1f3591640 1 Processor -- start 2024-09-16T17:05:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.873+0000 7fd1f3591640 1 -- start start 2024-09-16T17:05:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f3591640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f3591640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ec0a0060 con 0x7fd1ec09d3a0 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f3591640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ec09fd30 con 0x7fd1ec09ca50 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f132d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f132d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36858/0 (socket says 172.21.15.59:36858) 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f132d640 1 -- 172.21.15.59:0/3355326163 learned_addr learned my addr 172.21.15.59:0/3355326163 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f0b2c640 1 --1- 172.21.15.59:0/3355326163 >> v1:172.21.15.59:6789/0 conn(0x7fd1ec09d3a0 0x7fd1ec135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52358/0 (socket says 172.21.15.59:52358) 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f132d640 1 -- 172.21.15.59:0/3355326163 >> v1:172.21.15.59:6789/0 conn(0x7fd1ec09d3a0 legacy=0x7fd1ec135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f132d640 1 -- 172.21.15.59:0/3355326163 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec09e3c0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1e3fff640 1 -- 172.21.15.59:0/3355326163 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192647855 0 0) 0x7fd1ec0a0060 con 0x7fd1ec09d3a0 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1f132d640 1 --2- 172.21.15.59:0/3355326163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec09ce60 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4684375e0ab564b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.875+0000 7fd1e3fff640 1 -- 172.21.15.59:0/3355326163 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e8009e40 con 0x7fd1ec09ca50 2024-09-16T17:05:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1e3fff640 1 -- 172.21.15.59:0/3355326163 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd1e800e230 con 0x7fd1ec09ca50 2024-09-16T17:05:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1e3fff640 1 -- 172.21.15.59:0/3355326163 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e800e4d0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 -- 172.21.15.59:0/3355326163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 msgr2=0x7fd1ec09ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 --2- 172.21.15.59:0/3355326163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec09ce60 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 -- 172.21.15.59:0/3355326163 shutdown_connections 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 --2- 172.21.15.59:0/3355326163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=CLOSED pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 -- 172.21.15.59:0/3355326163 >> 172.21.15.59:0/3355326163 conn(0x7fd1ec0a5230 msgr2=0x7fd1ec0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 -- 172.21.15.59:0/3355326163 shutdown_connections 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.876+0000 7fd1f3591640 1 -- 172.21.15.59:0/3355326163 wait complete. 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.877+0000 7fd1f3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.878+0000 7fd1f3591640 1 Processor -- start 2024-09-16T17:05:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.878+0000 7fd1f3591640 1 -- start start 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f3591640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec124c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f3591640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec123510 con 0x7fd1ec09ca50 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f132d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec124c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f132d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec124c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36860/0 (socket says 172.21.15.59:36860) 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f132d640 1 -- 172.21.15.59:0/2997405514 learned_addr learned my addr 172.21.15.59:0/2997405514 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f132d640 1 -- 172.21.15.59:0/2997405514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec135e30 con 0x7fd1ec09ca50 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.880+0000 7fd1f132d640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec124c50 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.881+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e800ed90 con 0x7fd1ec09ca50 2024-09-16T17:05:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.881+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd1e8015420 con 0x7fd1ec09ca50 2024-09-16T17:05:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.881+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e80156c0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.881+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec122ec0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.881+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec122bb0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.882+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd1e8015870 con 0x7fd1ec09ca50 2024-09-16T17:05:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.882+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec1252a0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.882+0000 7fd1e1ffb640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd1d003e930 0x7fd1d0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.882+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fd1e8050ec0 con 0x7fd1ec09ca50 2024-09-16T17:05:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.883+0000 7fd1f0b2c640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd1d003e930 0x7fd1d0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.883+0000 7fd1f0b2c640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd1d003e930 0x7fd1d0040e40 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:05:59.888+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd1e800f2a0 con 0x7fd1ec09ca50 2024-09-16T17:06:00.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.073+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1ec125960 con 0x7fd1ec09ca50 2024-09-16T17:06:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.074+0000 7fd1e1ffb640 1 -- 172.21.15.59:0/2997405514 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v724) ==== 74+0+11272 (crc 0 0 0) 0x7fd1e80059f0 con 0x7fd1ec09ca50 2024-09-16T17:06:00.075 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:06:00.075 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":724,"fsid":"c43301f4-656b-4707-8343-bef82748353c","created":"2024-09-16T16:46:51.399285+0000","modified":"2024-09-16T17:05:58.041848+0000","last_up_change":"2024-09-16T16:46:59.731924+0000","last_in_change":"2024-09-16T16:46:53.559221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:59.742175+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:47:01.733857+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-16T16:52:02.616735+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70230068-ea94-49e2-a797-ef4f17b0c695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":3457013714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":3457013714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":3457013714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":3457013714}]},"public_addr":"172.21.15.59:6800/3457013714","cluster_addr":"172.21.15.59:6801/3457013714","heartbeat_back_addr":"172.21.15.59:6803/3457013714","heartbeat_front_addr":"172.21.15.59:6802/3457013714","state":["exists","up"]},{"osd":1,"uuid":"cbd286db-cb94-419f-b8ce-33ea74e96834","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":1210870840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1210870840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1210870840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1210870840}]},"public_addr":"172.21.15.59:6811/1210870840","cluster_addr":"172.21.15.59:6810/1210870840","heartbeat_back_addr":"172.21.15.59:6809/1210870840","heartbeat_front_addr":"172.21.15.59:6808/1210870840","state":["exists","up"]},{"osd":2,"uuid":"aeb9d5ee-8cc0-4c33-9106-f48928765e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6803","nonce":2992308739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2992308739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":2992308739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2992308739}]},"public_addr":"172.21.15.104:6803/2992308739","cluster_addr":"172.21.15.104:6804/2992308739","heartbeat_back_addr":"172.21.15.104:6817/2992308739","heartbeat_front_addr":"172.21.15.104:6816/2992308739","state":["exists","up"]},{"osd":3,"uuid":"1ff449c9-1ddc-4f1a-bb65-cb2c2d078fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":851587968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":851587968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":851587968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6811","nonce":851587968}]},"public_addr":"172.21.15.104:6808/851587968","cluster_addr":"172.21.15.104:6809/851587968","heartbeat_back_addr":"172.21.15.104:6810/851587968","heartbeat_front_addr":"172.21.15.104:6811/851587968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:06:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd1d003e930 msgr2=0x7fd1d0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd1d003e930 0x7fd1d0040e40 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 msgr2=0x7fd1ec124c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec124c50 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 shutdown_connections 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fd1d003e930 0x7fd1d0040e40 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 --2- 172.21.15.59:0/2997405514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec124c50 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 >> 172.21.15.59:0/2997405514 conn(0x7fd1ec0a5230 msgr2=0x7fd1ec0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 shutdown_connections 2024-09-16T17:06:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:00.076+0000 7fd1f3591640 1 -- 172.21.15.59:0/2997405514 wait complete. 2024-09-16T17:06:01.089 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T17:06:01.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.213+0000 7fccbdf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.223+0000 7fccbdf91640 1 Processor -- start 2024-09-16T17:06:01.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.224+0000 7fccbdf91640 1 -- start start 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccbdf91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccb809d810 0x7fccb809dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccbdf91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb809eda0 con 0x7fccb809e160 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccbdf91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fccb80a29e0 con 0x7fccb809d810 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccb77fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccb809d810 0x7fccb809dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccb77fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccb809d810 0x7fccb809dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33430/0 (socket says 172.21.15.59:33430) 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccb6ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fccb809e160 0x7fccb8132ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37290/0 (socket says 172.21.15.59:37290) 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.225+0000 7fccb77fe640 1 -- 172.21.15.59:0/1310093489 learned_addr learned my addr 172.21.15.59:0/1310093489 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.226+0000 7fccb77fe640 1 -- 172.21.15.59:0/1310093489 >> v1:172.21.15.59:6789/0 conn(0x7fccb809e160 legacy=0x7fccb8132ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.226+0000 7fccb77fe640 1 -- 172.21.15.59:0/1310093489 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80a27b0 con 0x7fccb809d810 2024-09-16T17:06:01.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.226+0000 7fccb77fe640 1 --2- 172.21.15.59:0/1310093489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb809dc20 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2cb857d3436279 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.226+0000 7fccb67fc640 1 -- 172.21.15.59:0/1310093489 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcca8009e50 con 0x7fccb809d810 2024-09-16T17:06:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.226+0000 7fccb67fc640 1 -- 172.21.15.59:0/1310093489 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcca800e230 con 0x7fccb809d810 2024-09-16T17:06:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.226+0000 7fccb67fc640 1 -- 172.21.15.59:0/1310093489 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcca800e4d0 con 0x7fccb809d810 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 -- 172.21.15.59:0/1310093489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 msgr2=0x7fccb809dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 --2- 172.21.15.59:0/1310093489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb809dc20 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 -- 172.21.15.59:0/1310093489 shutdown_connections 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 --2- 172.21.15.59:0/1310093489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb809dc20 unknown :-1 s=CLOSED pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 -- 172.21.15.59:0/1310093489 >> 172.21.15.59:0/1310093489 conn(0x7fccb80a31b0 msgr2=0x7fccb80a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 -- 172.21.15.59:0/1310093489 shutdown_connections 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 1 -- 172.21.15.59:0/1310093489 wait complete. 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.227+0000 7fccbdf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.229+0000 7fccbdf91640 1 Processor -- start 2024-09-16T17:06:01.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.229+0000 7fccbdf91640 1 -- start start 2024-09-16T17:06:01.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccbdf91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb8122050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccbdf91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fccb8121b00 con 0x7fccb809d810 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccb77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb8122050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccb77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb8122050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33434/0 (socket says 172.21.15.59:33434) 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccb77fe640 1 -- 172.21.15.59:0/3280024414 learned_addr learned my addr 172.21.15.59:0/3280024414 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccb77fe640 1 -- 172.21.15.59:0/3280024414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80a20d0 con 0x7fccb809d810 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccb77fe640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb8122050 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcca800ede0 con 0x7fccb809d810 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcca8015420 con 0x7fccb809d810 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb81214c0 con 0x7fccb809d810 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcca80156c0 con 0x7fccb809d810 2024-09-16T17:06:01.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.231+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb8123d70 con 0x7fccb809d810 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.232+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccb8121900 con 0x7fccb809d810 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcca8015870 con 0x7fccb809d810 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fcc9ffff640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcca403e930 0x7fcca4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fcca8050f20 con 0x7fccb809d810 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fcc9ffff640 1 --2- 172.21.15.59:0/3280024414 >> v2:172.21.15.59:6800/3457013714 conn(0x7fcca4044ad0 0x7fcca4046fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 --> v2:172.21.15.59:6800/3457013714 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcca4047650 con 0x7fcca4044ad0 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7fcca8053410 con 0x7fccb809d810 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.233+0000 7fccb6ffd640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcca403e930 0x7fcca4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.234+0000 7fccb6ffd640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcca403e930 0x7fcca4040e40 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.234+0000 7fccb7fff640 1 --2- 172.21.15.59:0/3280024414 >> v2:172.21.15.59:6800/3457013714 conn(0x7fcca4044ad0 0x7fcca4046fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:01.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.238+0000 7fccb7fff640 1 --2- 172.21.15.59:0/3280024414 >> v2:172.21.15.59:6800/3457013714 conn(0x7fcca4044ad0 0x7fcca4046fc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.240+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== osd.0 v2:172.21.15.59:6800/3457013714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fcca4047650 con 0x7fcca4044ad0 2024-09-16T17:06:01.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.243+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 --> v2:172.21.15.59:6800/3457013714 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fccb809e3b0 con 0x7fcca4044ad0 2024-09-16T17:06:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fcc9ffff640 1 -- 172.21.15.59:0/3280024414 <== osd.0 v2:172.21.15.59:6800/3457013714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fccb809e3b0 con 0x7fcca4044ad0 2024-09-16T17:06:01.246 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-16T17:06:01.246 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "" 2024-09-16T17:06:01.246 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-16T17:06:01.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 >> v2:172.21.15.59:6800/3457013714 conn(0x7fcca4044ad0 msgr2=0x7fcca4046fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 --2- 172.21.15.59:0/3280024414 >> v2:172.21.15.59:6800/3457013714 conn(0x7fcca4044ad0 0x7fcca4046fc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcca403e930 msgr2=0x7fcca4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcca403e930 0x7fcca4040e40 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 msgr2=0x7fccb8122050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb8122050 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 shutdown_connections 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 --2- 172.21.15.59:0/3280024414 >> v2:172.21.15.59:6800/3457013714 conn(0x7fcca4044ad0 0x7fcca4046fc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fcca403e930 0x7fcca4040e40 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 --2- 172.21.15.59:0/3280024414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccb809d810 0x7fccb8122050 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 >> 172.21.15.59:0/3280024414 conn(0x7fccb80a31b0 msgr2=0x7fccb80730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 shutdown_connections 2024-09-16T17:06:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.245+0000 7fccbdf91640 1 -- 172.21.15.59:0/3280024414 wait complete. 2024-09-16T17:06:01.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T17:06:01.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.365+0000 7f44b7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.372+0000 7f44b7191640 1 Processor -- start 2024-09-16T17:06:01.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.372+0000 7f44b7191640 1 -- start start 2024-09-16T17:06:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.373+0000 7f44b7191640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44b009ca50 0x7f44b009ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.373+0000 7f44b7191640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b00a0060 con 0x7f44b009d3a0 2024-09-16T17:06:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.373+0000 7f44b7191640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f44b009fd30 con 0x7f44b009ca50 2024-09-16T17:06:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44b4f2d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44b009ca50 0x7f44b009ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44b4f2d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44b009ca50 0x7f44b009ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33440/0 (socket says 172.21.15.59:33440) 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44affff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f44b009d3a0 0x7f44b0135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37296/0 (socket says 172.21.15.59:37296) 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44b4f2d640 1 -- 172.21.15.59:0/3341651174 learned_addr learned my addr 172.21.15.59:0/3341651174 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44b4f2d640 1 -- 172.21.15.59:0/3341651174 >> v1:172.21.15.59:6789/0 conn(0x7f44b009d3a0 legacy=0x7f44b0135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44b4f2d640 1 -- 172.21.15.59:0/3341651174 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b009e3c0 con 0x7f44b009ca50 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44af7fe640 1 -- 172.21.15.59:0/3341651174 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546518047 0 0) 0x7f44b00a0060 con 0x7f44b009d3a0 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44b4f2d640 1 --2- 172.21.15.59:0/3341651174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b009ce60 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9785506a84b22540 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44af7fe640 1 -- 172.21.15.59:0/3341651174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44a4009e40 con 0x7f44b009ca50 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44af7fe640 1 -- 172.21.15.59:0/3341651174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f44a400e230 con 0x7f44b009ca50 2024-09-16T17:06:01.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.374+0000 7f44af7fe640 1 -- 172.21.15.59:0/3341651174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44a400e4d0 con 0x7f44b009ca50 2024-09-16T17:06:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 -- 172.21.15.59:0/3341651174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 msgr2=0x7f44b009ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 --2- 172.21.15.59:0/3341651174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b009ce60 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 -- 172.21.15.59:0/3341651174 shutdown_connections 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 --2- 172.21.15.59:0/3341651174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b009ce60 unknown :-1 s=CLOSED pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 -- 172.21.15.59:0/3341651174 >> 172.21.15.59:0/3341651174 conn(0x7f44b00a5230 msgr2=0x7f44b00a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 -- 172.21.15.59:0/3341651174 shutdown_connections 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 1 -- 172.21.15.59:0/3341651174 wait complete. 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.375+0000 7f44b7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.377+0000 7f44b7191640 1 Processor -- start 2024-09-16T17:06:01.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.377+0000 7f44b7191640 1 -- start start 2024-09-16T17:06:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b7191640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b0124c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b7191640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0136230 con 0x7f44b009ca50 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b4f2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b0124c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b4f2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b0124c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33446/0 (socket says 172.21.15.59:33446) 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b4f2d640 1 -- 172.21.15.59:0/1036097292 learned_addr learned my addr 172.21.15.59:0/1036097292 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b4f2d640 1 -- 172.21.15.59:0/1036097292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b0123520 con 0x7f44b009ca50 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b4f2d640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b0124c60 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44a400edc0 con 0x7f44b009ca50 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f44a4015420 con 0x7f44b009ca50 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.379+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b0122ed0 con 0x7f44b009ca50 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.380+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f44a40156c0 con 0x7f44b009ca50 2024-09-16T17:06:01.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.380+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b0122bc0 con 0x7f44b009ca50 2024-09-16T17:06:01.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.380+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b009ce60 con 0x7f44b009ca50 2024-09-16T17:06:01.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.381+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f44a4015870 con 0x7f44b009ca50 2024-09-16T17:06:01.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.381+0000 7f44ad7fa640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f449403e930 0x7f4494040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.381+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f44a4050ef0 con 0x7f44b009ca50 2024-09-16T17:06:01.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.381+0000 7f44affff640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f449403e930 0x7f4494040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.382+0000 7f44affff640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f449403e930 0x7f4494040e40 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.386+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f44a400f2a0 con 0x7f44b009ca50 2024-09-16T17:06:01.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.572+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f44b009f9b0 con 0x7f449403e930 2024-09-16T17:06:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.574+0000 7f44ad7fa640 1 -- 172.21.15.59:0/1036097292 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f449c0012b0 con 0x7f449403e930 2024-09-16T17:06:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T17:06:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f449403e930 msgr2=0x7f4494040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f449403e930 0x7f4494040e40 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 msgr2=0x7f44b0124c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b0124c60 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 shutdown_connections 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f449403e930 0x7f4494040e40 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 --2- 172.21.15.59:0/1036097292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44b009ca50 0x7f44b0124c60 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 >> 172.21.15.59:0/1036097292 conn(0x7f44b00a5230 msgr2=0x7f44b00a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.578+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 shutdown_connections 2024-09-16T17:06:01.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.579+0000 7f44b7191640 1 -- 172.21.15.59:0/1036097292 wait complete. 2024-09-16T17:06:01.603 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T17:06:01.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:01.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.714+0000 7f4355791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.724+0000 7f4355791640 1 Processor -- start 2024-09-16T17:06:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.724+0000 7f4355791640 1 -- start start 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f4355791640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43500a1f20 0x7f435006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f4355791640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43500a27a0 con 0x7f435006ee10 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f4355791640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f435009d920 con 0x7f43500a1f20 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f434effd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43500a1f20 0x7f435006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f434effd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43500a1f20 0x7f435006e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33462/0 (socket says 172.21.15.59:33462) 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f434effd640 1 -- 172.21.15.59:0/3713678392 learned_addr learned my addr 172.21.15.59:0/3713678392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.726+0000 7f434e7fc640 1 --1- 172.21.15.59:0/3713678392 >> v1:172.21.15.59:6789/0 conn(0x7f435006ee10 0x7f4350135ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37306/0 (socket says 172.21.15.59:37306) 2024-09-16T17:06:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.727+0000 7f434effd640 1 -- 172.21.15.59:0/3713678392 >> v1:172.21.15.59:6789/0 conn(0x7f435006ee10 legacy=0x7f4350135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.727+0000 7f434effd640 1 -- 172.21.15.59:0/3713678392 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43500a2a40 con 0x7f43500a1f20 2024-09-16T17:06:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.727+0000 7f434effd640 1 --2- 172.21.15.59:0/3713678392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43500a1f20 0x7f435006e8d0 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3689a8a4b517e9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.727+0000 7f434dffb640 1 -- 172.21.15.59:0/3713678392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4340009e40 con 0x7f43500a1f20 2024-09-16T17:06:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.727+0000 7f434dffb640 1 -- 172.21.15.59:0/3713678392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f434000e230 con 0x7f43500a1f20 2024-09-16T17:06:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.727+0000 7f434dffb640 1 -- 172.21.15.59:0/3713678392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f434000e4d0 con 0x7f43500a1f20 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 -- 172.21.15.59:0/3713678392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43500a1f20 msgr2=0x7f435006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 --2- 172.21.15.59:0/3713678392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43500a1f20 0x7f435006e8d0 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 -- 172.21.15.59:0/3713678392 shutdown_connections 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 --2- 172.21.15.59:0/3713678392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43500a1f20 0x7f435006e8d0 unknown :-1 s=CLOSED pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 -- 172.21.15.59:0/3713678392 >> 172.21.15.59:0/3713678392 conn(0x7f43500a31b0 msgr2=0x7f43500a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 -- 172.21.15.59:0/3713678392 shutdown_connections 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 1 -- 172.21.15.59:0/3713678392 wait complete. 2024-09-16T17:06:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.728+0000 7f4355791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.730+0000 7f4355791640 1 Processor -- start 2024-09-16T17:06:01.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.730+0000 7f4355791640 1 -- start start 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.731+0000 7f4355791640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 0x7f4350124290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.731+0000 7f4355791640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4350123940 con 0x7f435006ee10 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.731+0000 7f434effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 0x7f4350124290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.731+0000 7f434effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 0x7f4350124290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33466/0 (socket says 172.21.15.59:33466) 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.731+0000 7f434effd640 1 -- 172.21.15.59:0/3541365774 learned_addr learned my addr 172.21.15.59:0/3541365774 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f434effd640 1 -- 172.21.15.59:0/3541365774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4350123ed0 con 0x7f435006ee10 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f434effd640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 0x7f4350124290 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f434000ed90 con 0x7f435006ee10 2024-09-16T17:06:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4340015420 con 0x7f435006ee10 2024-09-16T17:06:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43400156c0 con 0x7f435006ee10 2024-09-16T17:06:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4350125d30 con 0x7f435006ee10 2024-09-16T17:06:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.732+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4350123b30 con 0x7f435006ee10 2024-09-16T17:06:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.733+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f435006f220 con 0x7f435006ee10 2024-09-16T17:06:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.733+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4340015870 con 0x7f435006ee10 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.734+0000 7f43377fe640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f433c03e930 0x7f433c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.734+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f4340051000 con 0x7f435006ee10 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.734+0000 7f43377fe640 1 --2- 172.21.15.59:0/3541365774 >> v2:172.21.15.59:6811/1210870840 conn(0x7f433c044a70 0x7f433c046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.734+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 --> v2:172.21.15.59:6811/1210870840 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f433c0475f0 con 0x7f433c044a70 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.734+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7f43400534f0 con 0x7f435006ee10 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.734+0000 7f434e7fc640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f433c03e930 0x7f433c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.735+0000 7f434e7fc640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f433c03e930 0x7f433c040e40 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.735+0000 7f434f7fe640 1 --2- 172.21.15.59:0/3541365774 >> v2:172.21.15.59:6811/1210870840 conn(0x7f433c044a70 0x7f433c046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.738+0000 7f434f7fe640 1 --2- 172.21.15.59:0/3541365774 >> v2:172.21.15.59:6811/1210870840 conn(0x7f433c044a70 0x7f433c046f60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.740+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== osd.1 v2:172.21.15.59:6811/1210870840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f433c0475f0 con 0x7f433c044a70 2024-09-16T17:06:01.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.743+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 --> v2:172.21.15.59:6811/1210870840 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f435006f4b0 con 0x7f433c044a70 2024-09-16T17:06:01.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.745+0000 7f43377fe640 1 -- 172.21.15.59:0/3541365774 <== osd.1 v2:172.21.15.59:6811/1210870840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f435006f4b0 con 0x7f433c044a70 2024-09-16T17:06:01.746 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-16T17:06:01.747 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "" 2024-09-16T17:06:01.747 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 >> v2:172.21.15.59:6811/1210870840 conn(0x7f433c044a70 msgr2=0x7f433c046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 --2- 172.21.15.59:0/3541365774 >> v2:172.21.15.59:6811/1210870840 conn(0x7f433c044a70 0x7f433c046f60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f433c03e930 msgr2=0x7f433c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f433c03e930 0x7f433c040e40 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 msgr2=0x7f4350124290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 0x7f4350124290 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 shutdown_connections 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 --2- 172.21.15.59:0/3541365774 >> v2:172.21.15.59:6811/1210870840 conn(0x7f433c044a70 0x7f433c046f60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f433c03e930 0x7f433c040e40 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 --2- 172.21.15.59:0/3541365774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f435006ee10 0x7f4350124290 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 >> 172.21.15.59:0/3541365774 conn(0x7f43500a31b0 msgr2=0x7f4350071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 shutdown_connections 2024-09-16T17:06:01.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.746+0000 7f4355791640 1 -- 172.21.15.59:0/3541365774 wait complete. 2024-09-16T17:06:01.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T17:06:01.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.868+0000 7fc0bf6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.874+0000 7fc0bf6bd640 1 Processor -- start 2024-09-16T17:06:01.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.874+0000 7fc0bf6bd640 1 -- start start 2024-09-16T17:06:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bf6bd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0b8134770 0x7fc0b81391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bf6bd640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b80a2590 con 0x7fc0b8133c50 2024-09-16T17:06:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bf6bd640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b80a2c00 con 0x7fc0b8134770 2024-09-16T17:06:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bd459640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc0b8133c50 0x7fc0b8134060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37322/0 (socket says 172.21.15.59:37322) 2024-09-16T17:06:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bd459640 1 -- 172.21.15.59:0/356131378 learned_addr learned my addr 172.21.15.59:0/356131378 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bcc58640 1 --2- 172.21.15.59:0/356131378 >> v2:172.21.15.59:3300/0 conn(0x7fc0b8134770 0x7fc0b81391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bcc58640 1 -- 172.21.15.59:0/356131378 >> v1:172.21.15.59:6789/0 conn(0x7fc0b8133c50 legacy=0x7fc0b8134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0affff640 1 -- 172.21.15.59:0/356131378 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367405741 0 0) 0x7fc0b80a2590 con 0x7fc0b8133c50 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bcc58640 1 -- 172.21.15.59:0/356131378 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b809dfb0 con 0x7fc0b8134770 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.876+0000 7fc0bcc58640 1 --2- 172.21.15.59:0/356131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8134770 0x7fc0b81391e0 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea096f767ac79df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0affff640 1 -- 172.21.15.59:0/356131378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0a8009d90 con 0x7fc0b8134770 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0affff640 1 -- 172.21.15.59:0/356131378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0a800e230 con 0x7fc0b8134770 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0affff640 1 -- 172.21.15.59:0/356131378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0a800e4d0 con 0x7fc0b8134770 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/356131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8134770 msgr2=0x7fc0b81391e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0bf6bd640 1 --2- 172.21.15.59:0/356131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8134770 0x7fc0b81391e0 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/356131378 shutdown_connections 2024-09-16T17:06:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0bf6bd640 1 --2- 172.21.15.59:0/356131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8134770 0x7fc0b81391e0 unknown :-1 s=CLOSED pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/356131378 >> 172.21.15.59:0/356131378 conn(0x7fc0b80a3050 msgr2=0x7fc0b80a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.877+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/356131378 shutdown_connections 2024-09-16T17:06:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.878+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/356131378 wait complete. 2024-09-16T17:06:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.878+0000 7fc0bf6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.879+0000 7fc0bf6bd640 1 Processor -- start 2024-09-16T17:06:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.880+0000 7fc0bf6bd640 1 -- start start 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.881+0000 7fc0bf6bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 0x7fc0b81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.881+0000 7fc0bf6bd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8124460 con 0x7fc0b8133c50 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.881+0000 7fc0bd459640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 0x7fc0b81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.881+0000 7fc0bd459640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 0x7fc0b81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33496/0 (socket says 172.21.15.59:33496) 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.881+0000 7fc0bd459640 1 -- 172.21.15.59:0/1642230161 learned_addr learned my addr 172.21.15.59:0/1642230161 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.881+0000 7fc0bd459640 1 -- 172.21.15.59:0/1642230161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b8123a70 con 0x7fc0b8133c50 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.882+0000 7fc0bd459640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 0x7fc0b81c8660 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.882+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0b4004b80 con 0x7fc0b8133c50 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.882+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0b4004ce0 con 0x7fc0b8133c50 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.882+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b8120530 con 0x7fc0b8133c50 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.882+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0b4007120 con 0x7fc0b8133c50 2024-09-16T17:06:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.882+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b8120790 con 0x7fc0b8133c50 2024-09-16T17:06:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.883+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b8134060 con 0x7fc0b8133c50 2024-09-16T17:06:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.883+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc0b40072d0 con 0x7fc0b8133c50 2024-09-16T17:06:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.883+0000 7fc0adffb640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc09c03e930 0x7fc09c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.883+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fc0b404fac0 con 0x7fc0b8133c50 2024-09-16T17:06:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.884+0000 7fc0bcc58640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc09c03e930 0x7fc09c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.884+0000 7fc0bcc58640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc09c03e930 0x7fc09c040e40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:01.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:01.889+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc0b400f230 con 0x7fc0b8133c50 2024-09-16T17:06:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.073+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fc0b809dca0 con 0x7fc09c03e930 2024-09-16T17:06:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.074+0000 7fc0adffb640 1 -- 172.21.15.59:0/1642230161 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fc0a800e4c0 con 0x7fc09c03e930 2024-09-16T17:06:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T17:06:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc09c03e930 msgr2=0x7fc09c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc09c03e930 0x7fc09c040e40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 msgr2=0x7fc0b81c8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 0x7fc0b81c8660 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 shutdown_connections 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fc09c03e930 0x7fc09c040e40 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 --2- 172.21.15.59:0/1642230161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b8133c50 0x7fc0b81c8660 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 >> 172.21.15.59:0/1642230161 conn(0x7fc0b80a3050 msgr2=0x7fc0b80720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 shutdown_connections 2024-09-16T17:06:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.076+0000 7fc0bf6bd640 1 -- 172.21.15.59:0/1642230161 wait complete. 2024-09-16T17:06:02.090 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T17:06:02.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:02.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.203+0000 7f2b91b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.213+0000 7f2b91b91640 1 Processor -- start 2024-09-16T17:06:02.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.213+0000 7f2b91b91640 1 -- start start 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.214+0000 7f2b91b91640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b8c133900 0x7f2b8c138020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.214+0000 7f2b91b91640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8c074770 con 0x7f2b8c132de0 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.214+0000 7f2b91b91640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8c072580 con 0x7f2b8c133900 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.214+0000 7f2b8b7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2b8c132de0 0x7f2b8c1331f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37326/0 (socket says 172.21.15.59:37326) 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.214+0000 7f2b8b7fe640 1 -- 172.21.15.59:0/1446521413 learned_addr learned my addr 172.21.15.59:0/1446521413 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.214+0000 7f2b8affd640 1 --2- 172.21.15.59:0/1446521413 >> v2:172.21.15.59:3300/0 conn(0x7f2b8c133900 0x7f2b8c138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8affd640 1 -- 172.21.15.59:0/1446521413 >> v1:172.21.15.59:6789/0 conn(0x7f2b8c132de0 legacy=0x7f2b8c1331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8affd640 1 -- 172.21.15.59:0/1446521413 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c072710 con 0x7f2b8c133900 2024-09-16T17:06:02.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8a7fc640 1 -- 172.21.15.59:0/1446521413 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3176979772 0 0) 0x7f2b8c074770 con 0x7f2b8c132de0 2024-09-16T17:06:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8affd640 1 --2- 172.21.15.59:0/1446521413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c133900 0x7f2b8c138020 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a86deba6f2437 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8a7fc640 1 -- 172.21.15.59:0/1446521413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b80009d90 con 0x7f2b8c133900 2024-09-16T17:06:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8a7fc640 1 -- 172.21.15.59:0/1446521413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b8000e230 con 0x7f2b8c133900 2024-09-16T17:06:02.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.215+0000 7f2b8a7fc640 1 -- 172.21.15.59:0/1446521413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b8000e4d0 con 0x7f2b8c133900 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 -- 172.21.15.59:0/1446521413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c133900 msgr2=0x7f2b8c138020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1446521413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c133900 0x7f2b8c138020 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 -- 172.21.15.59:0/1446521413 shutdown_connections 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1446521413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c133900 0x7f2b8c138020 unknown :-1 s=CLOSED pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 -- 172.21.15.59:0/1446521413 >> 172.21.15.59:0/1446521413 conn(0x7f2b8c0a33b0 msgr2=0x7f2b8c0a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 -- 172.21.15.59:0/1446521413 shutdown_connections 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 1 -- 172.21.15.59:0/1446521413 wait complete. 2024-09-16T17:06:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.216+0000 7f2b91b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.218+0000 7f2b91b91640 1 Processor -- start 2024-09-16T17:06:02.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.218+0000 7f2b91b91640 1 -- start start 2024-09-16T17:06:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b91b91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 0x7f2b8c120210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b91b91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c11f7f0 con 0x7f2b8c132de0 2024-09-16T17:06:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 0x7f2b8c120210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 0x7f2b8c120210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33516/0 (socket says 172.21.15.59:33516) 2024-09-16T17:06:02.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b8b7fe640 1 -- 172.21.15.59:0/1666074743 learned_addr learned my addr 172.21.15.59:0/1666074743 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b8b7fe640 1 -- 172.21.15.59:0/1666074743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c11fdc0 con 0x7f2b8c132de0 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b8b7fe640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 0x7f2b8c120210 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b7c004b80 con 0x7f2b8c132de0 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c0a3f40 con 0x7f2b8c132de0 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b7c004ce0 con 0x7f2b8c132de0 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b7c007120 con 0x7f2b8c132de0 2024-09-16T17:06:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.220+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c11fa20 con 0x7f2b8c132de0 2024-09-16T17:06:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.221+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b8c0744f0 con 0x7f2b8c132de0 2024-09-16T17:06:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.221+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2b7c0072d0 con 0x7f2b8c132de0 2024-09-16T17:06:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.222+0000 7f2b73fff640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2b7803e930 0x7f2b78040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.222+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f2b7c04f8a0 con 0x7f2b8c132de0 2024-09-16T17:06:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.222+0000 7f2b73fff640 1 --2- 172.21.15.59:0/1666074743 >> v2:172.21.15.104:6803/2992308739 conn(0x7f2b78044a70 0x7f2b78046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.222+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 --> v2:172.21.15.104:6803/2992308739 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b780475f0 con 0x7f2b78044a70 2024-09-16T17:06:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.222+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7f2b7c04fc30 con 0x7f2b8c132de0 2024-09-16T17:06:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.222+0000 7f2b8affd640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2b7803e930 0x7f2b78040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.223+0000 7f2b8affd640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2b7803e930 0x7f2b78040e40 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.223+0000 7f2b8bfff640 1 --2- 172.21.15.59:0/1666074743 >> v2:172.21.15.104:6803/2992308739 conn(0x7f2b78044a70 0x7f2b78046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.227+0000 7f2b8bfff640 1 --2- 172.21.15.59:0/1666074743 >> v2:172.21.15.104:6803/2992308739 conn(0x7f2b78044a70 0x7f2b78046f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.229+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== osd.2 v2:172.21.15.104:6803/2992308739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f2b780475f0 con 0x7f2b78044a70 2024-09-16T17:06:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.233+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 --> v2:172.21.15.104:6803/2992308739 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2b8c0a4350 con 0x7f2b78044a70 2024-09-16T17:06:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b73fff640 1 -- 172.21.15.59:0/1666074743 <== osd.2 v2:172.21.15.104:6803/2992308739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f2b8400a820 con 0x7f2b78044a70 2024-09-16T17:06:02.236 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-16T17:06:02.236 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "" 2024-09-16T17:06:02.236 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 >> v2:172.21.15.104:6803/2992308739 conn(0x7f2b78044a70 msgr2=0x7f2b78046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1666074743 >> v2:172.21.15.104:6803/2992308739 conn(0x7f2b78044a70 0x7f2b78046f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2b7803e930 msgr2=0x7f2b78040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2b7803e930 0x7f2b78040e40 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 msgr2=0x7f2b8c120210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 0x7f2b8c120210 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 shutdown_connections 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1666074743 >> v2:172.21.15.104:6803/2992308739 conn(0x7f2b78044a70 0x7f2b78046f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f2b7803e930 0x7f2b78040e40 unknown :-1 s=CLOSED pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 --2- 172.21.15.59:0/1666074743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b8c132de0 0x7f2b8c120210 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 >> 172.21.15.59:0/1666074743 conn(0x7f2b8c0a33b0 msgr2=0x7f2b8c09eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 shutdown_connections 2024-09-16T17:06:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.235+0000 7f2b91b91640 1 -- 172.21.15.59:0/1666074743 wait complete. 2024-09-16T17:06:02.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T17:06:02.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.354+0000 7fa04bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.361+0000 7fa04bf51640 1 Processor -- start 2024-09-16T17:06:02.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.361+0000 7fa04bf51640 1 -- start start 2024-09-16T17:06:02.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa04bf51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa04409d570 0x7fa04413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa04bf51640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0440a0060 con 0x7fa04409ca50 2024-09-16T17:06:02.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa04bf51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa04409fd30 con 0x7fa04409d570 2024-09-16T17:06:02.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa0494ec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa04409d570 0x7fa04413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa049ced640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa04409ca50 0x7fa04409ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37334/0 (socket says 172.21.15.59:37334) 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa0494ec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa04409d570 0x7fa04413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33518/0 (socket says 172.21.15.59:33518) 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa049ced640 1 -- 172.21.15.59:0/1926141089 learned_addr learned my addr 172.21.15.59:0/1926141089 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa0494ec640 1 -- 172.21.15.59:0/1926141089 >> v1:172.21.15.59:6789/0 conn(0x7fa04409ca50 legacy=0x7fa04409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa0494ec640 1 -- 172.21.15.59:0/1926141089 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04409e3c0 con 0x7fa04409d570 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa0494ec640 1 --2- 172.21.15.59:0/1926141089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409d570 0x7fa04413b3b0 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1968e19783c21802 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa048ceb640 1 -- 172.21.15.59:0/1926141089 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa038009d80 con 0x7fa04409d570 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa048ceb640 1 -- 172.21.15.59:0/1926141089 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa03800e230 con 0x7fa04409d570 2024-09-16T17:06:02.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.363+0000 7fa048ceb640 1 -- 172.21.15.59:0/1926141089 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa03800e4d0 con 0x7fa04409d570 2024-09-16T17:06:02.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 -- 172.21.15.59:0/1926141089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409d570 msgr2=0x7fa04413b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 --2- 172.21.15.59:0/1926141089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409d570 0x7fa04413b3b0 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 -- 172.21.15.59:0/1926141089 shutdown_connections 2024-09-16T17:06:02.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 --2- 172.21.15.59:0/1926141089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409d570 0x7fa04413b3b0 unknown :-1 s=CLOSED pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 -- 172.21.15.59:0/1926141089 >> 172.21.15.59:0/1926141089 conn(0x7fa0440a5230 msgr2=0x7fa0440a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 -- 172.21.15.59:0/1926141089 shutdown_connections 2024-09-16T17:06:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.364+0000 7fa04bf51640 1 -- 172.21.15.59:0/1926141089 wait complete. 2024-09-16T17:06:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.365+0000 7fa04bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.366+0000 7fa04bf51640 1 Processor -- start 2024-09-16T17:06:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.366+0000 7fa04bf51640 1 -- start start 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.368+0000 7fa04bf51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 0x7fa044122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.368+0000 7fa04bf51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa044124260 con 0x7fa04409ca50 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.368+0000 7fa049ced640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 0x7fa044122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.368+0000 7fa049ced640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 0x7fa044122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33522/0 (socket says 172.21.15.59:33522) 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.368+0000 7fa049ced640 1 -- 172.21.15.59:0/546095326 learned_addr learned my addr 172.21.15.59:0/546095326 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.368+0000 7fa049ced640 1 -- 172.21.15.59:0/546095326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa044126cf0 con 0x7fa04409ca50 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.369+0000 7fa049ced640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 0x7fa044122dc0 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.369+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa03c005a60 con 0x7fa04409ca50 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.369+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa03c005bc0 con 0x7fa04409ca50 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.369+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0441269c0 con 0x7fa04409ca50 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.369+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa03c005e60 con 0x7fa04409ca50 2024-09-16T17:06:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.369+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa044126620 con 0x7fa04409ca50 2024-09-16T17:06:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.370+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa044125120 con 0x7fa04409ca50 2024-09-16T17:06:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.370+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa03c0070b0 con 0x7fa04409ca50 2024-09-16T17:06:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.370+0000 7fa0427fc640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa03003e960 0x7fa030040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.370+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fa03c04f9c0 con 0x7fa04409ca50 2024-09-16T17:06:02.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.371+0000 7fa0494ec640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa03003e960 0x7fa030040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.371+0000 7fa0494ec640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa03003e960 0x7fa030040e70 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.376+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa03c00dc60 con 0x7fa04409ca50 2024-09-16T17:06:02.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.563+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa04409f9b0 con 0x7fa03003e960 2024-09-16T17:06:02.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.564+0000 7fa0427fc640 1 -- 172.21.15.59:0/546095326 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fa038009da0 con 0x7fa03003e960 2024-09-16T17:06:02.565 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.566+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa03003e960 msgr2=0x7fa030040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.566+0000 7fa04bf51640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa03003e960 0x7fa030040e70 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.566+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 msgr2=0x7fa044122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.566+0000 7fa04bf51640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 0x7fa044122dc0 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.567+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 shutdown_connections 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.567+0000 7fa04bf51640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa03003e960 0x7fa030040e70 unknown :-1 s=CLOSED pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.567+0000 7fa04bf51640 1 --2- 172.21.15.59:0/546095326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04409ca50 0x7fa044122dc0 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.567+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 >> 172.21.15.59:0/546095326 conn(0x7fa0440a5230 msgr2=0x7fa0440a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.567+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 shutdown_connections 2024-09-16T17:06:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.567+0000 7fa04bf51640 1 -- 172.21.15.59:0/546095326 wait complete. 2024-09-16T17:06:02.580 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T17:06:02.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.689+0000 7faa06ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.699+0000 7faa06ad1640 1 Processor -- start 2024-09-16T17:06:02.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.699+0000 7faa06ad1640 1 -- start start 2024-09-16T17:06:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7faa06ad1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa0009e330 0x7faa001390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7faa06ad1640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0009eda0 con 0x7faa0009d810 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7faa06ad1640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7faa000a29e0 con 0x7faa0009e330 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7faa0486d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faa0009d810 0x7faa0009dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37338/0 (socket says 172.21.15.59:37338) 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7faa0486d640 1 -- 172.21.15.59:0/966489332 learned_addr learned my addr 172.21.15.59:0/966489332 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7fa9fffff640 1 --2- 172.21.15.59:0/966489332 >> v2:172.21.15.59:3300/0 conn(0x7faa0009e330 0x7faa001390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7fa9fffff640 1 -- 172.21.15.59:0/966489332 >> v1:172.21.15.59:6789/0 conn(0x7faa0009d810 legacy=0x7faa0009dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7fa9fffff640 1 -- 172.21.15.59:0/966489332 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa000a27b0 con 0x7faa0009e330 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.701+0000 7fa9ff7fe640 1 -- 172.21.15.59:0/966489332 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445048887 0 0) 0x7faa0009eda0 con 0x7faa0009d810 2024-09-16T17:06:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7fa9fffff640 1 --2- 172.21.15.59:0/966489332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009e330 0x7faa001390e0 crc :-1 s=READY pgs=13016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c02fc84e016d4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7fa9ff7fe640 1 -- 172.21.15.59:0/966489332 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9f4009d90 con 0x7faa0009e330 2024-09-16T17:06:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7fa9ff7fe640 1 -- 172.21.15.59:0/966489332 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa9f400e230 con 0x7faa0009e330 2024-09-16T17:06:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7fa9ff7fe640 1 -- 172.21.15.59:0/966489332 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9f400e4d0 con 0x7faa0009e330 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7faa06ad1640 1 -- 172.21.15.59:0/966489332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009e330 msgr2=0x7faa001390e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7faa06ad1640 1 --2- 172.21.15.59:0/966489332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009e330 0x7faa001390e0 crc :-1 s=READY pgs=13016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7faa06ad1640 1 -- 172.21.15.59:0/966489332 shutdown_connections 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7faa06ad1640 1 --2- 172.21.15.59:0/966489332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009e330 0x7faa001390e0 unknown :-1 s=CLOSED pgs=13016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.702+0000 7faa06ad1640 1 -- 172.21.15.59:0/966489332 >> 172.21.15.59:0/966489332 conn(0x7faa000a31b0 msgr2=0x7faa000a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.703+0000 7faa06ad1640 1 -- 172.21.15.59:0/966489332 shutdown_connections 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.703+0000 7faa06ad1640 1 -- 172.21.15.59:0/966489332 wait complete. 2024-09-16T17:06:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.703+0000 7faa06ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.704+0000 7faa06ad1640 1 Processor -- start 2024-09-16T17:06:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.705+0000 7faa06ad1640 1 -- start start 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.706+0000 7faa06ad1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 0x7faa00120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.706+0000 7faa06ad1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa00133440 con 0x7faa0009d810 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.706+0000 7faa0486d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 0x7faa00120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.706+0000 7faa0486d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 0x7faa00120730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33532/0 (socket says 172.21.15.59:33532) 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.706+0000 7faa0486d640 1 -- 172.21.15.59:0/3275874487 learned_addr learned my addr 172.21.15.59:0/3275874487 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7faa0486d640 1 -- 172.21.15.59:0/3275874487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa001221e0 con 0x7faa0009d810 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7faa0486d640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 0x7faa00120730 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9f0004b80 con 0x7faa0009d810 2024-09-16T17:06:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa9f0004ce0 con 0x7faa0009d810 2024-09-16T17:06:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa00121970 con 0x7faa0009d810 2024-09-16T17:06:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9f0007120 con 0x7faa0009d810 2024-09-16T17:06:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.707+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa00123000 con 0x7faa0009d810 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.708+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa000a19f0 con 0x7faa0009d810 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.708+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa9f00072d0 con 0x7faa0009d810 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.708+0000 7fa9fd7fa640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa9ec03e930 0x7fa9ec040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.709+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fa9f004fac0 con 0x7faa0009d810 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.709+0000 7fa9fd7fa640 1 --2- 172.21.15.59:0/3275874487 >> v2:172.21.15.104:6808/851587968 conn(0x7fa9ec044a70 0x7fa9ec046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.709+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 --> v2:172.21.15.104:6808/851587968 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9ec0475f0 con 0x7fa9ec044a70 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.709+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7fa9f004fe50 con 0x7faa0009d810 2024-09-16T17:06:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.709+0000 7fa9fffff640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa9ec03e930 0x7fa9ec040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.709+0000 7fa9fffff640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa9ec03e930 0x7fa9ec040e40 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.710+0000 7faa0506e640 1 --2- 172.21.15.59:0/3275874487 >> v2:172.21.15.104:6808/851587968 conn(0x7fa9ec044a70 0x7fa9ec046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.714+0000 7faa0506e640 1 --2- 172.21.15.59:0/3275874487 >> v2:172.21.15.104:6808/851587968 conn(0x7fa9ec044a70 0x7fa9ec046f60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.716+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== osd.3 v2:172.21.15.104:6808/851587968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fa9ec0475f0 con 0x7fa9ec044a70 2024-09-16T17:06:02.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.719+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 --> v2:172.21.15.104:6808/851587968 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa0009e580 con 0x7fa9ec044a70 2024-09-16T17:06:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.721+0000 7fa9fd7fa640 1 -- 172.21.15.59:0/3275874487 <== osd.3 v2:172.21.15.104:6808/851587968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7faa0009e580 con 0x7fa9ec044a70 2024-09-16T17:06:02.722 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-16T17:06:02.722 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "" 2024-09-16T17:06:02.722 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-16T17:06:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 >> v2:172.21.15.104:6808/851587968 conn(0x7fa9ec044a70 msgr2=0x7fa9ec046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 --2- 172.21.15.59:0/3275874487 >> v2:172.21.15.104:6808/851587968 conn(0x7fa9ec044a70 0x7fa9ec046f60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa9ec03e930 msgr2=0x7fa9ec040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa9ec03e930 0x7fa9ec040e40 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 msgr2=0x7faa00120730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 0x7faa00120730 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 shutdown_connections 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 --2- 172.21.15.59:0/3275874487 >> v2:172.21.15.104:6808/851587968 conn(0x7fa9ec044a70 0x7fa9ec046f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa9ec03e930 0x7fa9ec040e40 unknown :-1 s=CLOSED pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 --2- 172.21.15.59:0/3275874487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa0009d810 0x7faa00120730 unknown :-1 s=CLOSED pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 >> 172.21.15.59:0/3275874487 conn(0x7faa000a31b0 msgr2=0x7faa000a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 shutdown_connections 2024-09-16T17:06:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.722+0000 7faa06ad1640 1 -- 172.21.15.59:0/3275874487 wait complete. 2024-09-16T17:06:02.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T17:06:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.841+0000 7fa34fcfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.847+0000 7fa34fcfd640 1 Processor -- start 2024-09-16T17:06:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.848+0000 7fa34fcfd640 1 -- start start 2024-09-16T17:06:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34fcfd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa34809f040 0x7fa348068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34fcfd640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa34806d370 con 0x7fa34809e910 2024-09-16T17:06:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34fcfd640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa348070cb0 con 0x7fa34809f040 2024-09-16T17:06:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34da99640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa34809f040 0x7fa348068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34d298640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa34809e910 0x7fa348069280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37354/0 (socket says 172.21.15.59:37354) 2024-09-16T17:06:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34da99640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa34809f040 0x7fa348068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33546/0 (socket says 172.21.15.59:33546) 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.849+0000 7fa34d298640 1 -- 172.21.15.59:0/2545276800 learned_addr learned my addr 172.21.15.59:0/2545276800 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34da99640 1 -- 172.21.15.59:0/2545276800 >> v1:172.21.15.59:6789/0 conn(0x7fa34809e910 legacy=0x7fa348069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34da99640 1 -- 172.21.15.59:0/2545276800 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34809c1c0 con 0x7fa34809f040 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34ca97640 1 -- 172.21.15.59:0/2545276800 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315537967 0 0) 0x7fa34806d370 con 0x7fa34809e910 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34da99640 1 --2- 172.21.15.59:0/2545276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809f040 0x7fa348068d40 crc :-1 s=READY pgs=13019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffd8f17ff871497 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34ca97640 1 -- 172.21.15.59:0/2545276800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa344009d90 con 0x7fa34809f040 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34ca97640 1 -- 172.21.15.59:0/2545276800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa34400e230 con 0x7fa34809f040 2024-09-16T17:06:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.850+0000 7fa34ca97640 1 -- 172.21.15.59:0/2545276800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa34400e4d0 con 0x7fa34809f040 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 -- 172.21.15.59:0/2545276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809f040 msgr2=0x7fa348068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 --2- 172.21.15.59:0/2545276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809f040 0x7fa348068d40 crc :-1 s=READY pgs=13019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 -- 172.21.15.59:0/2545276800 shutdown_connections 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 --2- 172.21.15.59:0/2545276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809f040 0x7fa348068d40 unknown :-1 s=CLOSED pgs=13019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 -- 172.21.15.59:0/2545276800 >> 172.21.15.59:0/2545276800 conn(0x7fa3480a32a0 msgr2=0x7fa3480a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 -- 172.21.15.59:0/2545276800 shutdown_connections 2024-09-16T17:06:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 1 -- 172.21.15.59:0/2545276800 wait complete. 2024-09-16T17:06:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.851+0000 7fa34fcfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.853+0000 7fa34fcfd640 1 Processor -- start 2024-09-16T17:06:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.853+0000 7fa34fcfd640 1 -- start start 2024-09-16T17:06:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.854+0000 7fa34fcfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 0x7fa3481383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.854+0000 7fa34fcfd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa34809bc90 con 0x7fa34809e910 2024-09-16T17:06:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34da99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 0x7fa3481383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34da99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 0x7fa3481383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33550/0 (socket says 172.21.15.59:33550) 2024-09-16T17:06:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34da99640 1 -- 172.21.15.59:0/489378463 learned_addr learned my addr 172.21.15.59:0/489378463 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34da99640 1 -- 172.21.15.59:0/489378463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3480716e0 con 0x7fa34809e910 2024-09-16T17:06:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34da99640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 0x7fa3481383a0 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa344014620 con 0x7fa34809e910 2024-09-16T17:06:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa344014780 con 0x7fa34809e910 2024-09-16T17:06:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa348099c60 con 0x7fa34809e910 2024-09-16T17:06:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa344014a20 con 0x7fa34809e910 2024-09-16T17:06:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.855+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa348097a00 con 0x7fa34809e910 2024-09-16T17:06:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.856+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa348068d40 con 0x7fa34809e910 2024-09-16T17:06:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.856+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa344014c20 con 0x7fa34809e910 2024-09-16T17:06:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.857+0000 7fa33e7fc640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa32c03e8e0 0x7fa32c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.857+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fa344019040 con 0x7fa34809e910 2024-09-16T17:06:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.857+0000 7fa34d298640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa32c03e8e0 0x7fa32c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.858+0000 7fa34d298640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa32c03e8e0 0x7fa32c040df0 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:02.862+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa344011380 con 0x7fa34809e910 2024-09-16T17:06:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.050+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa348072680 con 0x7fa32c03e8e0 2024-09-16T17:06:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.051+0000 7fa33e7fc640 1 -- 172.21.15.59:0/489378463 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fa338001270 con 0x7fa32c03e8e0 2024-09-16T17:06:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T17:06:03.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa32c03e8e0 msgr2=0x7fa32c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:03.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa32c03e8e0 0x7fa32c040df0 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 msgr2=0x7fa3481383a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:03.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 0x7fa3481383a0 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 shutdown_connections 2024-09-16T17:06:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fa32c03e8e0 0x7fa32c040df0 unknown :-1 s=CLOSED pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 --2- 172.21.15.59:0/489378463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa34809e910 0x7fa3481383a0 unknown :-1 s=CLOSED pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 >> 172.21.15.59:0/489378463 conn(0x7fa3480a32a0 msgr2=0x7fa348072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 shutdown_connections 2024-09-16T17:06:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.053+0000 7fa34fcfd640 1 -- 172.21.15.59:0/489378463 wait complete. 2024-09-16T17:06:03.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.176+0000 7fb595991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.182+0000 7fb595991640 1 Processor -- start 2024-09-16T17:06:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.182+0000 7fb595991640 1 -- start start 2024-09-16T17:06:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.183+0000 7fb595991640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59009ca50 0x7fb59009ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.183+0000 7fb595991640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5900a0060 con 0x7fb59009d3a0 2024-09-16T17:06:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.183+0000 7fb595991640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb59009fd30 con 0x7fb59009ca50 2024-09-16T17:06:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.183+0000 7fb58effd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59009ca50 0x7fb59009ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58effd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59009ca50 0x7fb59009ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33558/0 (socket says 172.21.15.59:33558) 2024-09-16T17:06:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58effd640 1 -- 172.21.15.59:0/726473639 learned_addr learned my addr 172.21.15.59:0/726473639 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.183+0000 7fb58e7fc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb59009d3a0 0x7fb590135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37364/0 (socket says 172.21.15.59:37364) 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58effd640 1 -- 172.21.15.59:0/726473639 >> v1:172.21.15.59:6789/0 conn(0x7fb59009d3a0 legacy=0x7fb590135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58effd640 1 -- 172.21.15.59:0/726473639 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59009e3c0 con 0x7fb59009ca50 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58effd640 1 --2- 172.21.15.59:0/726473639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb59009ce60 crc :-1 s=READY pgs=13022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93679e4621f3f4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58dffb640 1 -- 172.21.15.59:0/726473639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb58000e040 con 0x7fb59009ca50 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58dffb640 1 -- 172.21.15.59:0/726473639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5800091e0 con 0x7fb59009ca50 2024-09-16T17:06:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.184+0000 7fb58dffb640 1 -- 172.21.15.59:0/726473639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb580007730 con 0x7fb59009ca50 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 -- 172.21.15.59:0/726473639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 msgr2=0x7fb59009ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 --2- 172.21.15.59:0/726473639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb59009ce60 crc :-1 s=READY pgs=13022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 -- 172.21.15.59:0/726473639 shutdown_connections 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 --2- 172.21.15.59:0/726473639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb59009ce60 unknown :-1 s=CLOSED pgs=13022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 -- 172.21.15.59:0/726473639 >> 172.21.15.59:0/726473639 conn(0x7fb5900a5230 msgr2=0x7fb5900a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 -- 172.21.15.59:0/726473639 shutdown_connections 2024-09-16T17:06:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 1 -- 172.21.15.59:0/726473639 wait complete. 2024-09-16T17:06:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.185+0000 7fb595991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.187+0000 7fb595991640 1 Processor -- start 2024-09-16T17:06:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.187+0000 7fb595991640 1 -- start start 2024-09-16T17:06:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb595991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb590122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb595991640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb590136da0 con 0x7fb59009ca50 2024-09-16T17:06:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb58effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb590122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb58effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb590122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33574/0 (socket says 172.21.15.59:33574) 2024-09-16T17:06:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb58effd640 1 -- 172.21.15.59:0/2807164718 learned_addr learned my addr 172.21.15.59:0/2807164718 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb58effd640 1 -- 172.21.15.59:0/2807164718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb590126cf0 con 0x7fb59009ca50 2024-09-16T17:06:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb58effd640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb590122d10 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb58000e040 con 0x7fb59009ca50 2024-09-16T17:06:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5800094d0 con 0x7fb59009ca50 2024-09-16T17:06:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb590136a70 con 0x7fb59009ca50 2024-09-16T17:06:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb580010960 con 0x7fb59009ca50 2024-09-16T17:06:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.189+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5900a3830 con 0x7fb59009ca50 2024-09-16T17:06:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.190+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb590124fc0 con 0x7fb59009ca50 2024-09-16T17:06:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.191+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb580010b60 con 0x7fb59009ca50 2024-09-16T17:06:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.191+0000 7fb587fff640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb57003e8e0 0x7fb570040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.191+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fb580050f20 con 0x7fb59009ca50 2024-09-16T17:06:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.191+0000 7fb58e7fc640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb57003e8e0 0x7fb570040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.192+0000 7fb58e7fc640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb57003e8e0 0x7fb570040df0 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.196+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb5800145d0 con 0x7fb59009ca50 2024-09-16T17:06:03.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.379+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5900a1fc0 con 0x7fb57003e8e0 2024-09-16T17:06:03.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.382+0000 7fb587fff640 1 -- 172.21.15.59:0/2807164718 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109206 (crc 0 0 0) 0x7fb5900a1fc0 con 0x7fb57003e8e0 2024-09-16T17:06:03.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:06:03.384 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T17:06:03.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb57003e8e0 msgr2=0x7fb570040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:03.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb57003e8e0 0x7fb570040df0 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 msgr2=0x7fb590122d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb590122d10 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 shutdown_connections 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fb57003e8e0 0x7fb570040df0 unknown :-1 s=CLOSED pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 --2- 172.21.15.59:0/2807164718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009ca50 0x7fb590122d10 unknown :-1 s=CLOSED pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 >> 172.21.15.59:0/2807164718 conn(0x7fb5900a5230 msgr2=0x7fb5900a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 shutdown_connections 2024-09-16T17:06:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:03.384+0000 7fb595991640 1 -- 172.21.15.59:0/2807164718 wait complete. 2024-09-16T17:06:03.396 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":1288,"stamp":"2024-09-16T17:06:01.980869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":262696,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377224664,"statfs":{"total":386547056640,"available":386278055936,"internally_reserved":0,"allocated":14131200,"data_stored":6568956,"data_compressed":60086,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002395"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.088961+0000","last_change":"2024-09-16T16:52:04.699706+0000","last_active":"2024-09-16T17:05:58.088961+0000","last_peered":"2024-09-16T17:05:58.088961+0000","last_clean":"2024-09-16T17:05:58.088961+0000","last_became_active":"2024-09-16T16:52:04.683267+0000","last_became_peered":"2024-09-16T16:52:04.683267+0000","last_unstale":"2024-09-16T17:05:58.088961+0000","last_undegraded":"2024-09-16T17:05:58.088961+0000","last_fullsized":"2024-09-16T17:05:58.088961+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.106042+0000","last_change":"2024-09-16T16:52:04.761758+0000","last_active":"2024-09-16T17:05:58.106042+0000","last_peered":"2024-09-16T17:05:58.106042+0000","last_clean":"2024-09-16T17:05:58.106042+0000","last_became_active":"2024-09-16T16:52:04.744118+0000","last_became_peered":"2024-09-16T16:52:04.744118+0000","last_unstale":"2024-09-16T17:05:58.106042+0000","last_undegraded":"2024-09-16T17:05:58.106042+0000","last_fullsized":"2024-09-16T17:05:58.106042+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.079693+0000","last_change":"2024-09-16T16:52:04.668513+0000","last_active":"2024-09-16T17:05:58.079693+0000","last_peered":"2024-09-16T17:05:58.079693+0000","last_clean":"2024-09-16T17:05:58.079693+0000","last_became_active":"2024-09-16T16:52:04.659260+0000","last_became_peered":"2024-09-16T16:52:04.659260+0000","last_unstale":"2024-09-16T17:05:58.079693+0000","last_undegraded":"2024-09-16T17:05:58.079693+0000","last_fullsized":"2024-09-16T17:05:58.079693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.083742+0000","last_change":"2024-09-16T16:52:04.720609+0000","last_active":"2024-09-16T17:05:58.083742+0000","last_peered":"2024-09-16T17:05:58.083742+0000","last_clean":"2024-09-16T17:05:58.083742+0000","last_became_active":"2024-09-16T16:52:04.707958+0000","last_became_peered":"2024-09-16T16:52:04.707958+0000","last_unstale":"2024-09-16T17:05:58.083742+0000","last_undegraded":"2024-09-16T17:05:58.083742+0000","last_fullsized":"2024-09-16T17:05:58.083742+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.068142+0000","last_change":"2024-09-16T16:52:04.663528+0000","last_active":"2024-09-16T17:05:58.068142+0000","last_peered":"2024-09-16T17:05:58.068142+0000","last_clean":"2024-09-16T17:05:58.068142+0000","last_became_active":"2024-09-16T16:52:04.655240+0000","last_became_peered":"2024-09-16T16:52:04.655240+0000","last_unstale":"2024-09-16T17:05:58.068142+0000","last_undegraded":"2024-09-16T17:05:58.068142+0000","last_fullsized":"2024-09-16T17:05:58.068142+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.084612+0000","last_change":"2024-09-16T16:52:04.673009+0000","last_active":"2024-09-16T17:05:58.084612+0000","last_peered":"2024-09-16T17:05:58.084612+0000","last_clean":"2024-09-16T17:05:58.084612+0000","last_became_active":"2024-09-16T16:52:04.655040+0000","last_became_peered":"2024-09-16T16:52:04.655040+0000","last_unstale":"2024-09-16T17:05:58.084612+0000","last_undegraded":"2024-09-16T17:05:58.084612+0000","last_fullsized":"2024-09-16T17:05:58.084612+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.103302+0000","last_change":"2024-09-16T16:52:04.834460+0000","last_active":"2024-09-16T17:05:58.103302+0000","last_peered":"2024-09-16T17:05:58.103302+0000","last_clean":"2024-09-16T17:05:58.103302+0000","last_became_active":"2024-09-16T16:52:04.822727+0000","last_became_peered":"2024-09-16T16:52:04.822727+0000","last_unstale":"2024-09-16T17:05:58.103302+0000","last_undegraded":"2024-09-16T17:05:58.103302+0000","last_fullsized":"2024-09-16T17:05:58.103302+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.097622+0000","last_change":"2024-09-16T16:52:04.766288+0000","last_active":"2024-09-16T17:05:58.097622+0000","last_peered":"2024-09-16T17:05:58.097622+0000","last_clean":"2024-09-16T17:05:58.097622+0000","last_became_active":"2024-09-16T16:52:04.749230+0000","last_became_peered":"2024-09-16T16:52:04.749230+0000","last_unstale":"2024-09-16T17:05:58.097622+0000","last_undegraded":"2024-09-16T17:05:58.097622+0000","last_fullsized":"2024-09-16T17:05:58.097622+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.082721+0000","last_change":"2024-09-16T16:52:04.733335+0000","last_active":"2024-09-16T17:05:58.082721+0000","last_peered":"2024-09-16T17:05:58.082721+0000","last_clean":"2024-09-16T17:05:58.082721+0000","last_became_active":"2024-09-16T16:52:04.722821+0000","last_became_peered":"2024-09-16T16:52:04.722821+0000","last_unstale":"2024-09-16T17:05:58.082721+0000","last_undegraded":"2024-09-16T17:05:58.082721+0000","last_fullsized":"2024-09-16T17:05:58.082721+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.073293+0000","last_change":"2024-09-16T16:52:04.641248+0000","last_active":"2024-09-16T17:05:58.073293+0000","last_peered":"2024-09-16T17:05:58.073293+0000","last_clean":"2024-09-16T17:05:58.073293+0000","last_became_active":"2024-09-16T16:52:04.628000+0000","last_became_peered":"2024-09-16T16:52:04.628000+0000","last_unstale":"2024-09-16T17:05:58.073293+0000","last_undegraded":"2024-09-16T17:05:58.073293+0000","last_fullsized":"2024-09-16T17:05:58.073293+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.058307+0000","last_change":"2024-09-16T16:52:04.684071+0000","last_active":"2024-09-16T17:05:58.058307+0000","last_peered":"2024-09-16T17:05:58.058307+0000","last_clean":"2024-09-16T17:05:58.058307+0000","last_became_active":"2024-09-16T16:52:04.660722+0000","last_became_peered":"2024-09-16T16:52:04.660722+0000","last_unstale":"2024-09-16T17:05:58.058307+0000","last_undegraded":"2024-09-16T17:05:58.058307+0000","last_fullsized":"2024-09-16T17:05:58.058307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.106118+0000","last_change":"2024-09-16T16:52:04.751809+0000","last_active":"2024-09-16T17:05:58.106118+0000","last_peered":"2024-09-16T17:05:58.106118+0000","last_clean":"2024-09-16T17:05:58.106118+0000","last_became_active":"2024-09-16T16:52:04.705911+0000","last_became_peered":"2024-09-16T16:52:04.705911+0000","last_unstale":"2024-09-16T17:05:58.106118+0000","last_undegraded":"2024-09-16T17:05:58.106118+0000","last_fullsized":"2024-09-16T17:05:58.106118+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.085576+0000","last_change":"2024-09-16T16:52:04.722993+0000","last_active":"2024-09-16T17:05:58.085576+0000","last_peered":"2024-09-16T17:05:58.085576+0000","last_clean":"2024-09-16T17:05:58.085576+0000","last_became_active":"2024-09-16T16:52:04.711500+0000","last_became_peered":"2024-09-16T16:52:04.711500+0000","last_unstale":"2024-09-16T17:05:58.085576+0000","last_undegraded":"2024-09-16T17:05:58.085576+0000","last_fullsized":"2024-09-16T17:05:58.085576+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.076373+0000","last_change":"2024-09-16T16:52:04.788750+0000","last_active":"2024-09-16T17:05:58.076373+0000","last_peered":"2024-09-16T17:05:58.076373+0000","last_clean":"2024-09-16T17:05:58.076373+0000","last_became_active":"2024-09-16T16:52:04.784535+0000","last_became_peered":"2024-09-16T16:52:04.784535+0000","last_unstale":"2024-09-16T17:05:58.076373+0000","last_undegraded":"2024-09-16T17:05:58.076373+0000","last_fullsized":"2024-09-16T17:05:58.076373+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.118917+0000","last_change":"2024-09-16T16:52:04.746337+0000","last_active":"2024-09-16T17:05:58.118917+0000","last_peered":"2024-09-16T17:05:58.118917+0000","last_clean":"2024-09-16T17:05:58.118917+0000","last_became_active":"2024-09-16T16:52:04.727116+0000","last_became_peered":"2024-09-16T16:52:04.727116+0000","last_unstale":"2024-09-16T17:05:58.118917+0000","last_undegraded":"2024-09-16T17:05:58.118917+0000","last_fullsized":"2024-09-16T17:05:58.118917+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.115364+0000","last_change":"2024-09-16T16:52:04.827442+0000","last_active":"2024-09-16T17:05:58.115364+0000","last_peered":"2024-09-16T17:05:58.115364+0000","last_clean":"2024-09-16T17:05:58.115364+0000","last_became_active":"2024-09-16T16:52:04.814429+0000","last_became_peered":"2024-09-16T16:52:04.814429+0000","last_unstale":"2024-09-16T17:05:58.115364+0000","last_undegraded":"2024-09-16T17:05:58.115364+0000","last_fullsized":"2024-09-16T17:05:58.115364+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.109300+0000","last_change":"2024-09-16T16:52:04.730899+0000","last_active":"2024-09-16T17:05:58.109300+0000","last_peered":"2024-09-16T17:05:58.109300+0000","last_clean":"2024-09-16T17:05:58.109300+0000","last_became_active":"2024-09-16T16:52:04.704696+0000","last_became_peered":"2024-09-16T16:52:04.704696+0000","last_unstale":"2024-09-16T17:05:58.109300+0000","last_undegraded":"2024-09-16T17:05:58.109300+0000","last_fullsized":"2024-09-16T17:05:58.109300+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.069248+0000","last_change":"2024-09-16T16:52:04.688424+0000","last_active":"2024-09-16T17:05:58.069248+0000","last_peered":"2024-09-16T17:05:58.069248+0000","last_clean":"2024-09-16T17:05:58.069248+0000","last_became_active":"2024-09-16T16:52:04.668455+0000","last_became_peered":"2024-09-16T16:52:04.668455+0000","last_unstale":"2024-09-16T17:05:58.069248+0000","last_undegraded":"2024-09-16T17:05:58.069248+0000","last_fullsized":"2024-09-16T17:05:58.069248+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.059765+0000","last_change":"2024-09-16T16:52:04.664921+0000","last_active":"2024-09-16T17:05:58.059765+0000","last_peered":"2024-09-16T17:05:58.059765+0000","last_clean":"2024-09-16T17:05:58.059765+0000","last_became_active":"2024-09-16T16:52:04.647610+0000","last_became_peered":"2024-09-16T16:52:04.647610+0000","last_unstale":"2024-09-16T17:05:58.059765+0000","last_undegraded":"2024-09-16T17:05:58.059765+0000","last_fullsized":"2024-09-16T17:05:58.059765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.085144+0000","last_change":"2024-09-16T16:52:04.763162+0000","last_active":"2024-09-16T17:05:58.085144+0000","last_peered":"2024-09-16T17:05:58.085144+0000","last_clean":"2024-09-16T17:05:58.085144+0000","last_became_active":"2024-09-16T16:52:04.755722+0000","last_became_peered":"2024-09-16T16:52:04.755722+0000","last_unstale":"2024-09-16T17:05:58.085144+0000","last_undegraded":"2024-09-16T17:05:58.085144+0000","last_fullsized":"2024-09-16T17:05:58.085144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.072990+0000","last_change":"2024-09-16T16:52:04.797949+0000","last_active":"2024-09-16T17:05:58.072990+0000","last_peered":"2024-09-16T17:05:58.072990+0000","last_clean":"2024-09-16T17:05:58.072990+0000","last_became_active":"2024-09-16T16:52:04.791745+0000","last_became_peered":"2024-09-16T16:52:04.791745+0000","last_unstale":"2024-09-16T17:05:58.072990+0000","last_undegraded":"2024-09-16T17:05:58.072990+0000","last_fullsized":"2024-09-16T17:05:58.072990+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.067264+0000","last_change":"2024-09-16T16:52:04.698664+0000","last_active":"2024-09-16T17:05:58.067264+0000","last_peered":"2024-09-16T17:05:58.067264+0000","last_clean":"2024-09-16T17:05:58.067264+0000","last_became_active":"2024-09-16T16:52:04.686232+0000","last_became_peered":"2024-09-16T16:52:04.686232+0000","last_unstale":"2024-09-16T17:05:58.067264+0000","last_undegraded":"2024-09-16T17:05:58.067264+0000","last_fullsized":"2024-09-16T17:05:58.067264+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.084342+0000","last_change":"2024-09-16T16:52:04.682117+0000","last_active":"2024-09-16T17:05:58.084342+0000","last_peered":"2024-09-16T17:05:58.084342+0000","last_clean":"2024-09-16T17:05:58.084342+0000","last_became_active":"2024-09-16T16:52:04.674267+0000","last_became_peered":"2024-09-16T16:52:04.674267+0000","last_unstale":"2024-09-16T17:05:58.084342+0000","last_undegraded":"2024-09-16T17:05:58.084342+0000","last_fullsized":"2024-09-16T17:05:58.084342+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.061860+0000","last_change":"2024-09-16T16:52:04.678055+0000","last_active":"2024-09-16T17:05:58.061860+0000","last_peered":"2024-09-16T17:05:58.061860+0000","last_clean":"2024-09-16T17:05:58.061860+0000","last_became_active":"2024-09-16T16:52:04.651245+0000","last_became_peered":"2024-09-16T16:52:04.651245+0000","last_unstale":"2024-09-16T17:05:58.061860+0000","last_undegraded":"2024-09-16T17:05:58.061860+0000","last_fullsized":"2024-09-16T17:05:58.061860+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.084460+0000","last_change":"2024-09-16T16:52:04.725681+0000","last_active":"2024-09-16T17:05:58.084460+0000","last_peered":"2024-09-16T17:05:58.084460+0000","last_clean":"2024-09-16T17:05:58.084460+0000","last_became_active":"2024-09-16T16:52:04.716567+0000","last_became_peered":"2024-09-16T16:52:04.716567+0000","last_unstale":"2024-09-16T17:05:58.084460+0000","last_undegraded":"2024-09-16T17:05:58.084460+0000","last_fullsized":"2024-09-16T17:05:58.084460+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.110233+0000","last_change":"2024-09-16T16:52:04.848189+0000","last_active":"2024-09-16T17:05:58.110233+0000","last_peered":"2024-09-16T17:05:58.110233+0000","last_clean":"2024-09-16T17:05:58.110233+0000","last_became_active":"2024-09-16T16:52:04.840298+0000","last_became_peered":"2024-09-16T16:52:04.840298+0000","last_unstale":"2024-09-16T17:05:58.110233+0000","last_undegraded":"2024-09-16T17:05:58.110233+0000","last_fullsized":"2024-09-16T17:05:58.110233+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.077131+0000","last_change":"2024-09-16T16:52:04.756769+0000","last_active":"2024-09-16T17:05:58.077131+0000","last_peered":"2024-09-16T17:05:58.077131+0000","last_clean":"2024-09-16T17:05:58.077131+0000","last_became_active":"2024-09-16T16:52:04.751100+0000","last_became_peered":"2024-09-16T16:52:04.751100+0000","last_unstale":"2024-09-16T17:05:58.077131+0000","last_undegraded":"2024-09-16T17:05:58.077131+0000","last_fullsized":"2024-09-16T17:05:58.077131+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.107487+0000","last_change":"2024-09-16T16:52:04.797030+0000","last_active":"2024-09-16T17:05:58.107487+0000","last_peered":"2024-09-16T17:05:58.107487+0000","last_clean":"2024-09-16T17:05:58.107487+0000","last_became_active":"2024-09-16T16:52:04.789190+0000","last_became_peered":"2024-09-16T16:52:04.789190+0000","last_unstale":"2024-09-16T17:05:58.107487+0000","last_undegraded":"2024-09-16T17:05:58.107487+0000","last_fullsized":"2024-09-16T17:05:58.107487+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.104216+0000","last_change":"2024-09-16T16:52:04.818516+0000","last_active":"2024-09-16T17:05:58.104216+0000","last_peered":"2024-09-16T17:05:58.104216+0000","last_clean":"2024-09-16T17:05:58.104216+0000","last_became_active":"2024-09-16T16:52:04.805951+0000","last_became_peered":"2024-09-16T16:52:04.805951+0000","last_unstale":"2024-09-16T17:05:58.104216+0000","last_undegraded":"2024-09-16T17:05:58.104216+0000","last_fullsized":"2024-09-16T17:05:58.104216+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.082143+0000","last_change":"2024-09-16T16:52:04.747686+0000","last_active":"2024-09-16T17:05:58.082143+0000","last_peered":"2024-09-16T17:05:58.082143+0000","last_clean":"2024-09-16T17:05:58.082143+0000","last_became_active":"2024-09-16T16:52:04.711856+0000","last_became_peered":"2024-09-16T16:52:04.711856+0000","last_unstale":"2024-09-16T17:05:58.082143+0000","last_undegraded":"2024-09-16T17:05:58.082143+0000","last_fullsized":"2024-09-16T17:05:58.082143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1482,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.086194+0000","last_change":"2024-09-16T16:52:04.693250+0000","last_active":"2024-09-16T17:05:58.086194+0000","last_peered":"2024-09-16T17:05:58.086194+0000","last_clean":"2024-09-16T17:05:58.086194+0000","last_became_active":"2024-09-16T16:52:04.671009+0000","last_became_peered":"2024-09-16T16:52:04.671009+0000","last_unstale":"2024-09-16T17:05:58.086194+0000","last_undegraded":"2024-09-16T17:05:58.086194+0000","last_fullsized":"2024-09-16T17:05:58.086194+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.072685+0000","last_change":"2024-09-16T16:52:04.674154+0000","last_active":"2024-09-16T17:05:58.072685+0000","last_peered":"2024-09-16T17:05:58.072685+0000","last_clean":"2024-09-16T17:05:58.072685+0000","last_became_active":"2024-09-16T16:52:04.662483+0000","last_became_peered":"2024-09-16T16:52:04.662483+0000","last_unstale":"2024-09-16T17:05:58.072685+0000","last_undegraded":"2024-09-16T17:05:58.072685+0000","last_fullsized":"2024-09-16T17:05:58.072685+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.061054+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T17:05:58.061054+0000","last_peered":"2024-09-16T17:05:58.061054+0000","last_clean":"2024-09-16T17:05:58.061054+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T17:05:58.061054+0000","last_undegraded":"2024-09-16T17:05:58.061054+0000","last_fullsized":"2024-09-16T17:05:58.061054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.073207+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T17:05:58.073207+0000","last_peered":"2024-09-16T17:05:58.073207+0000","last_clean":"2024-09-16T17:05:58.073207+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T17:05:58.073207+0000","last_undegraded":"2024-09-16T17:05:58.073207+0000","last_fullsized":"2024-09-16T17:05:58.073207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.077878+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T17:05:58.077878+0000","last_peered":"2024-09-16T17:05:58.077878+0000","last_clean":"2024-09-16T17:05:58.077878+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T17:05:58.077878+0000","last_undegraded":"2024-09-16T17:05:58.077878+0000","last_fullsized":"2024-09-16T17:05:58.077878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.060345+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T17:05:58.060345+0000","last_peered":"2024-09-16T17:05:58.060345+0000","last_clean":"2024-09-16T17:05:58.060345+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T17:05:58.060345+0000","last_undegraded":"2024-09-16T17:05:58.060345+0000","last_fullsized":"2024-09-16T17:05:58.060345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.108309+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T17:05:58.108309+0000","last_peered":"2024-09-16T17:05:58.108309+0000","last_clean":"2024-09-16T17:05:58.108309+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T17:05:58.108309+0000","last_undegraded":"2024-09-16T17:05:58.108309+0000","last_fullsized":"2024-09-16T17:05:58.108309+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.061885+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T17:05:58.061885+0000","last_peered":"2024-09-16T17:05:58.061885+0000","last_clean":"2024-09-16T17:05:58.061885+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T17:05:58.061885+0000","last_undegraded":"2024-09-16T17:05:58.061885+0000","last_fullsized":"2024-09-16T17:05:58.061885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.094602+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T17:05:58.094602+0000","last_peered":"2024-09-16T17:05:58.094602+0000","last_clean":"2024-09-16T17:05:58.094602+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T17:05:58.094602+0000","last_undegraded":"2024-09-16T17:05:58.094602+0000","last_fullsized":"2024-09-16T17:05:58.094602+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2143,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.087930+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T17:05:58.087930+0000","last_peered":"2024-09-16T17:05:58.087930+0000","last_clean":"2024-09-16T17:05:58.087930+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T17:05:58.087930+0000","last_undegraded":"2024-09-16T17:05:58.087930+0000","last_fullsized":"2024-09-16T17:05:58.087930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2211,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.062321+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T17:05:58.062321+0000","last_peered":"2024-09-16T17:05:58.062321+0000","last_clean":"2024-09-16T17:05:58.062321+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T17:05:58.062321+0000","last_undegraded":"2024-09-16T17:05:58.062321+0000","last_fullsized":"2024-09-16T17:05:58.062321+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70564,"kb_used_data":3476,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301276,"statfs":{"total":96636764160,"available":96564506624,"internally_reserved":0,"allocated":3559424,"data_stored":1937411,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66352,"kb_used_data":3424,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305488,"statfs":{"total":96636764160,"available":96568819712,"internally_reserved":0,"allocated":3506176,"data_stored":1347067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949674099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64940,"kb_used_data":3420,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3502080,"data_stored":1347048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60840,"kb_used_data":3480,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311000,"statfs":{"total":96636764160,"available":96574464000,"internally_reserved":0,"allocated":3563520,"data_stored":1937430,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:03.401 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.401 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.401 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.401 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.401 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.402 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.403 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.404 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.405 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.405 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.405 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.405 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.406 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.406 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.406 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.406 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:47:00.736625+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:03.406 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:06:23.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:23.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.529+0000 7f93bf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:23.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.534+0000 7f93bf591640 1 Processor -- start 2024-09-16T17:06:23.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.535+0000 7f93bf591640 1 -- start start 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bf591640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b809af30 0x7f93b8133fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bf591640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b809d410 con 0x7f93b81344e0 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bf591640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f93b8133cd0 con 0x7f93b809af30 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bd32d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b809af30 0x7f93b8133fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bd32d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b809af30 0x7f93b8133fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54808/0 (socket says 172.21.15.59:54808) 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bd32d640 1 -- 172.21.15.59:0/2470116897 learned_addr learned my addr 172.21.15.59:0/2470116897 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.536+0000 7f93bcb2c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f93b81344e0 0x7f93b8130630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60744/0 (socket says 172.21.15.59:60744) 2024-09-16T17:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93bd32d640 1 -- 172.21.15.59:0/2470116897 >> v1:172.21.15.59:6789/0 conn(0x7f93b81344e0 legacy=0x7f93b8130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93bd32d640 1 -- 172.21.15.59:0/2470116897 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b809a930 con 0x7f93b809af30 2024-09-16T17:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93affff640 1 -- 172.21.15.59:0/2470116897 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811996649 0 0) 0x7f93b809d410 con 0x7f93b81344e0 2024-09-16T17:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93bd32d640 1 --2- 172.21.15.59:0/2470116897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b8133fa0 crc :-1 s=READY pgs=13025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e593932b60fb490d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93affff640 1 -- 172.21.15.59:0/2470116897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93b4009e50 con 0x7f93b809af30 2024-09-16T17:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93affff640 1 -- 172.21.15.59:0/2470116897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f93b400e230 con 0x7f93b809af30 2024-09-16T17:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.537+0000 7f93affff640 1 -- 172.21.15.59:0/2470116897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93b400e4d0 con 0x7f93b809af30 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 -- 172.21.15.59:0/2470116897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 msgr2=0x7f93b8133fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 --2- 172.21.15.59:0/2470116897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b8133fa0 crc :-1 s=READY pgs=13025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 -- 172.21.15.59:0/2470116897 shutdown_connections 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 --2- 172.21.15.59:0/2470116897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b8133fa0 unknown :-1 s=CLOSED pgs=13025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 -- 172.21.15.59:0/2470116897 >> 172.21.15.59:0/2470116897 conn(0x7f93b80a11f0 msgr2=0x7f93b80a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 -- 172.21.15.59:0/2470116897 shutdown_connections 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 1 -- 172.21.15.59:0/2470116897 wait complete. 2024-09-16T17:06:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.538+0000 7f93bf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:23.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.540+0000 7f93bf591640 1 Processor -- start 2024-09-16T17:06:23.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.540+0000 7f93bf591640 1 -- start start 2024-09-16T17:06:23.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bf591640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b80724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bf591640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80739f0 con 0x7f93b809af30 2024-09-16T17:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bd32d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b80724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bd32d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b80724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54814/0 (socket says 172.21.15.59:54814) 2024-09-16T17:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bd32d640 1 -- 172.21.15.59:0/943540187 learned_addr learned my addr 172.21.15.59:0/943540187 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bd32d640 1 -- 172.21.15.59:0/943540187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b8129310 con 0x7f93b809af30 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bd32d640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b80724d0 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93b400edc0 con 0x7f93b809af30 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f93b4015420 con 0x7f93b809af30 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b81309a0 con 0x7f93b809af30 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.542+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93b40156c0 con 0x7f93b809af30 2024-09-16T17:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.543+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b81301a0 con 0x7f93b809af30 2024-09-16T17:06:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.544+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b81303f0 con 0x7f93b809af30 2024-09-16T17:06:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.544+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f93b4015870 con 0x7f93b809af30 2024-09-16T17:06:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.544+0000 7f93adffb640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f939c03e930 0x7f939c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.544+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f93b4050fa0 con 0x7f93b809af30 2024-09-16T17:06:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.545+0000 7f93bcb2c640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f939c03e930 0x7f939c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.545+0000 7f93bcb2c640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f939c03e930 0x7f939c040e40 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.549+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f93b81303f0 con 0x7f93b809af30 2024-09-16T17:06:23.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.731+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93b81324a0 con 0x7f939c03e930 2024-09-16T17:06:23.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.735+0000 7f93adffb640 1 -- 172.21.15.59:0/943540187 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109192 (crc 0 0 0) 0x7f93a80012b0 con 0x7f939c03e930 2024-09-16T17:06:23.737 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:06:23.737 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.736+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f939c03e930 msgr2=0x7f939c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.736+0000 7f93bf591640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f939c03e930 0x7f939c040e40 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 msgr2=0x7f93b80724d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b80724d0 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 shutdown_connections 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f939c03e930 0x7f939c040e40 unknown :-1 s=CLOSED pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 --2- 172.21.15.59:0/943540187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b809af30 0x7f93b80724d0 unknown :-1 s=CLOSED pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 >> 172.21.15.59:0/943540187 conn(0x7f93b80a11f0 msgr2=0x7f93b809d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 shutdown_connections 2024-09-16T17:06:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:23.737+0000 7f93bf591640 1 -- 172.21.15.59:0/943540187 wait complete. 2024-09-16T17:06:23.750 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":1298,"stamp":"2024-09-16T17:06:21.986076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":262696,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377224664,"statfs":{"total":386547056640,"available":386278055936,"internally_reserved":0,"allocated":14131200,"data_stored":6568956,"data_compressed":60086,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003147"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.088961+0000","last_change":"2024-09-16T16:52:04.699706+0000","last_active":"2024-09-16T17:05:58.088961+0000","last_peered":"2024-09-16T17:05:58.088961+0000","last_clean":"2024-09-16T17:05:58.088961+0000","last_became_active":"2024-09-16T16:52:04.683267+0000","last_became_peered":"2024-09-16T16:52:04.683267+0000","last_unstale":"2024-09-16T17:05:58.088961+0000","last_undegraded":"2024-09-16T17:05:58.088961+0000","last_fullsized":"2024-09-16T17:05:58.088961+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.106042+0000","last_change":"2024-09-16T16:52:04.761758+0000","last_active":"2024-09-16T17:05:58.106042+0000","last_peered":"2024-09-16T17:05:58.106042+0000","last_clean":"2024-09-16T17:05:58.106042+0000","last_became_active":"2024-09-16T16:52:04.744118+0000","last_became_peered":"2024-09-16T16:52:04.744118+0000","last_unstale":"2024-09-16T17:05:58.106042+0000","last_undegraded":"2024-09-16T17:05:58.106042+0000","last_fullsized":"2024-09-16T17:05:58.106042+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.079693+0000","last_change":"2024-09-16T16:52:04.668513+0000","last_active":"2024-09-16T17:05:58.079693+0000","last_peered":"2024-09-16T17:05:58.079693+0000","last_clean":"2024-09-16T17:05:58.079693+0000","last_became_active":"2024-09-16T16:52:04.659260+0000","last_became_peered":"2024-09-16T16:52:04.659260+0000","last_unstale":"2024-09-16T17:05:58.079693+0000","last_undegraded":"2024-09-16T17:05:58.079693+0000","last_fullsized":"2024-09-16T17:05:58.079693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.083742+0000","last_change":"2024-09-16T16:52:04.720609+0000","last_active":"2024-09-16T17:05:58.083742+0000","last_peered":"2024-09-16T17:05:58.083742+0000","last_clean":"2024-09-16T17:05:58.083742+0000","last_became_active":"2024-09-16T16:52:04.707958+0000","last_became_peered":"2024-09-16T16:52:04.707958+0000","last_unstale":"2024-09-16T17:05:58.083742+0000","last_undegraded":"2024-09-16T17:05:58.083742+0000","last_fullsized":"2024-09-16T17:05:58.083742+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.068142+0000","last_change":"2024-09-16T16:52:04.663528+0000","last_active":"2024-09-16T17:05:58.068142+0000","last_peered":"2024-09-16T17:05:58.068142+0000","last_clean":"2024-09-16T17:05:58.068142+0000","last_became_active":"2024-09-16T16:52:04.655240+0000","last_became_peered":"2024-09-16T16:52:04.655240+0000","last_unstale":"2024-09-16T17:05:58.068142+0000","last_undegraded":"2024-09-16T17:05:58.068142+0000","last_fullsized":"2024-09-16T17:05:58.068142+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.084612+0000","last_change":"2024-09-16T16:52:04.673009+0000","last_active":"2024-09-16T17:05:58.084612+0000","last_peered":"2024-09-16T17:05:58.084612+0000","last_clean":"2024-09-16T17:05:58.084612+0000","last_became_active":"2024-09-16T16:52:04.655040+0000","last_became_peered":"2024-09-16T16:52:04.655040+0000","last_unstale":"2024-09-16T17:05:58.084612+0000","last_undegraded":"2024-09-16T17:05:58.084612+0000","last_fullsized":"2024-09-16T17:05:58.084612+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.103302+0000","last_change":"2024-09-16T16:52:04.834460+0000","last_active":"2024-09-16T17:05:58.103302+0000","last_peered":"2024-09-16T17:05:58.103302+0000","last_clean":"2024-09-16T17:05:58.103302+0000","last_became_active":"2024-09-16T16:52:04.822727+0000","last_became_peered":"2024-09-16T16:52:04.822727+0000","last_unstale":"2024-09-16T17:05:58.103302+0000","last_undegraded":"2024-09-16T17:05:58.103302+0000","last_fullsized":"2024-09-16T17:05:58.103302+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.097622+0000","last_change":"2024-09-16T16:52:04.766288+0000","last_active":"2024-09-16T17:05:58.097622+0000","last_peered":"2024-09-16T17:05:58.097622+0000","last_clean":"2024-09-16T17:05:58.097622+0000","last_became_active":"2024-09-16T16:52:04.749230+0000","last_became_peered":"2024-09-16T16:52:04.749230+0000","last_unstale":"2024-09-16T17:05:58.097622+0000","last_undegraded":"2024-09-16T17:05:58.097622+0000","last_fullsized":"2024-09-16T17:05:58.097622+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.082721+0000","last_change":"2024-09-16T16:52:04.733335+0000","last_active":"2024-09-16T17:05:58.082721+0000","last_peered":"2024-09-16T17:05:58.082721+0000","last_clean":"2024-09-16T17:05:58.082721+0000","last_became_active":"2024-09-16T16:52:04.722821+0000","last_became_peered":"2024-09-16T16:52:04.722821+0000","last_unstale":"2024-09-16T17:05:58.082721+0000","last_undegraded":"2024-09-16T17:05:58.082721+0000","last_fullsized":"2024-09-16T17:05:58.082721+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.073293+0000","last_change":"2024-09-16T16:52:04.641248+0000","last_active":"2024-09-16T17:05:58.073293+0000","last_peered":"2024-09-16T17:05:58.073293+0000","last_clean":"2024-09-16T17:05:58.073293+0000","last_became_active":"2024-09-16T16:52:04.628000+0000","last_became_peered":"2024-09-16T16:52:04.628000+0000","last_unstale":"2024-09-16T17:05:58.073293+0000","last_undegraded":"2024-09-16T17:05:58.073293+0000","last_fullsized":"2024-09-16T17:05:58.073293+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.058307+0000","last_change":"2024-09-16T16:52:04.684071+0000","last_active":"2024-09-16T17:05:58.058307+0000","last_peered":"2024-09-16T17:05:58.058307+0000","last_clean":"2024-09-16T17:05:58.058307+0000","last_became_active":"2024-09-16T16:52:04.660722+0000","last_became_peered":"2024-09-16T16:52:04.660722+0000","last_unstale":"2024-09-16T17:05:58.058307+0000","last_undegraded":"2024-09-16T17:05:58.058307+0000","last_fullsized":"2024-09-16T17:05:58.058307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.106118+0000","last_change":"2024-09-16T16:52:04.751809+0000","last_active":"2024-09-16T17:05:58.106118+0000","last_peered":"2024-09-16T17:05:58.106118+0000","last_clean":"2024-09-16T17:05:58.106118+0000","last_became_active":"2024-09-16T16:52:04.705911+0000","last_became_peered":"2024-09-16T16:52:04.705911+0000","last_unstale":"2024-09-16T17:05:58.106118+0000","last_undegraded":"2024-09-16T17:05:58.106118+0000","last_fullsized":"2024-09-16T17:05:58.106118+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.085576+0000","last_change":"2024-09-16T16:52:04.722993+0000","last_active":"2024-09-16T17:05:58.085576+0000","last_peered":"2024-09-16T17:05:58.085576+0000","last_clean":"2024-09-16T17:05:58.085576+0000","last_became_active":"2024-09-16T16:52:04.711500+0000","last_became_peered":"2024-09-16T16:52:04.711500+0000","last_unstale":"2024-09-16T17:05:58.085576+0000","last_undegraded":"2024-09-16T17:05:58.085576+0000","last_fullsized":"2024-09-16T17:05:58.085576+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.076373+0000","last_change":"2024-09-16T16:52:04.788750+0000","last_active":"2024-09-16T17:05:58.076373+0000","last_peered":"2024-09-16T17:05:58.076373+0000","last_clean":"2024-09-16T17:05:58.076373+0000","last_became_active":"2024-09-16T16:52:04.784535+0000","last_became_peered":"2024-09-16T16:52:04.784535+0000","last_unstale":"2024-09-16T17:05:58.076373+0000","last_undegraded":"2024-09-16T17:05:58.076373+0000","last_fullsized":"2024-09-16T17:05:58.076373+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.118917+0000","last_change":"2024-09-16T16:52:04.746337+0000","last_active":"2024-09-16T17:05:58.118917+0000","last_peered":"2024-09-16T17:05:58.118917+0000","last_clean":"2024-09-16T17:05:58.118917+0000","last_became_active":"2024-09-16T16:52:04.727116+0000","last_became_peered":"2024-09-16T16:52:04.727116+0000","last_unstale":"2024-09-16T17:05:58.118917+0000","last_undegraded":"2024-09-16T17:05:58.118917+0000","last_fullsized":"2024-09-16T17:05:58.118917+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.115364+0000","last_change":"2024-09-16T16:52:04.827442+0000","last_active":"2024-09-16T17:05:58.115364+0000","last_peered":"2024-09-16T17:05:58.115364+0000","last_clean":"2024-09-16T17:05:58.115364+0000","last_became_active":"2024-09-16T16:52:04.814429+0000","last_became_peered":"2024-09-16T16:52:04.814429+0000","last_unstale":"2024-09-16T17:05:58.115364+0000","last_undegraded":"2024-09-16T17:05:58.115364+0000","last_fullsized":"2024-09-16T17:05:58.115364+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.109300+0000","last_change":"2024-09-16T16:52:04.730899+0000","last_active":"2024-09-16T17:05:58.109300+0000","last_peered":"2024-09-16T17:05:58.109300+0000","last_clean":"2024-09-16T17:05:58.109300+0000","last_became_active":"2024-09-16T16:52:04.704696+0000","last_became_peered":"2024-09-16T16:52:04.704696+0000","last_unstale":"2024-09-16T17:05:58.109300+0000","last_undegraded":"2024-09-16T17:05:58.109300+0000","last_fullsized":"2024-09-16T17:05:58.109300+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.069248+0000","last_change":"2024-09-16T16:52:04.688424+0000","last_active":"2024-09-16T17:05:58.069248+0000","last_peered":"2024-09-16T17:05:58.069248+0000","last_clean":"2024-09-16T17:05:58.069248+0000","last_became_active":"2024-09-16T16:52:04.668455+0000","last_became_peered":"2024-09-16T16:52:04.668455+0000","last_unstale":"2024-09-16T17:05:58.069248+0000","last_undegraded":"2024-09-16T17:05:58.069248+0000","last_fullsized":"2024-09-16T17:05:58.069248+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.059765+0000","last_change":"2024-09-16T16:52:04.664921+0000","last_active":"2024-09-16T17:05:58.059765+0000","last_peered":"2024-09-16T17:05:58.059765+0000","last_clean":"2024-09-16T17:05:58.059765+0000","last_became_active":"2024-09-16T16:52:04.647610+0000","last_became_peered":"2024-09-16T16:52:04.647610+0000","last_unstale":"2024-09-16T17:05:58.059765+0000","last_undegraded":"2024-09-16T17:05:58.059765+0000","last_fullsized":"2024-09-16T17:05:58.059765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.085144+0000","last_change":"2024-09-16T16:52:04.763162+0000","last_active":"2024-09-16T17:05:58.085144+0000","last_peered":"2024-09-16T17:05:58.085144+0000","last_clean":"2024-09-16T17:05:58.085144+0000","last_became_active":"2024-09-16T16:52:04.755722+0000","last_became_peered":"2024-09-16T16:52:04.755722+0000","last_unstale":"2024-09-16T17:05:58.085144+0000","last_undegraded":"2024-09-16T17:05:58.085144+0000","last_fullsized":"2024-09-16T17:05:58.085144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.072990+0000","last_change":"2024-09-16T16:52:04.797949+0000","last_active":"2024-09-16T17:05:58.072990+0000","last_peered":"2024-09-16T17:05:58.072990+0000","last_clean":"2024-09-16T17:05:58.072990+0000","last_became_active":"2024-09-16T16:52:04.791745+0000","last_became_peered":"2024-09-16T16:52:04.791745+0000","last_unstale":"2024-09-16T17:05:58.072990+0000","last_undegraded":"2024-09-16T17:05:58.072990+0000","last_fullsized":"2024-09-16T17:05:58.072990+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.067264+0000","last_change":"2024-09-16T16:52:04.698664+0000","last_active":"2024-09-16T17:05:58.067264+0000","last_peered":"2024-09-16T17:05:58.067264+0000","last_clean":"2024-09-16T17:05:58.067264+0000","last_became_active":"2024-09-16T16:52:04.686232+0000","last_became_peered":"2024-09-16T16:52:04.686232+0000","last_unstale":"2024-09-16T17:05:58.067264+0000","last_undegraded":"2024-09-16T17:05:58.067264+0000","last_fullsized":"2024-09-16T17:05:58.067264+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.084342+0000","last_change":"2024-09-16T16:52:04.682117+0000","last_active":"2024-09-16T17:05:58.084342+0000","last_peered":"2024-09-16T17:05:58.084342+0000","last_clean":"2024-09-16T17:05:58.084342+0000","last_became_active":"2024-09-16T16:52:04.674267+0000","last_became_peered":"2024-09-16T16:52:04.674267+0000","last_unstale":"2024-09-16T17:05:58.084342+0000","last_undegraded":"2024-09-16T17:05:58.084342+0000","last_fullsized":"2024-09-16T17:05:58.084342+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.061860+0000","last_change":"2024-09-16T16:52:04.678055+0000","last_active":"2024-09-16T17:05:58.061860+0000","last_peered":"2024-09-16T17:05:58.061860+0000","last_clean":"2024-09-16T17:05:58.061860+0000","last_became_active":"2024-09-16T16:52:04.651245+0000","last_became_peered":"2024-09-16T16:52:04.651245+0000","last_unstale":"2024-09-16T17:05:58.061860+0000","last_undegraded":"2024-09-16T17:05:58.061860+0000","last_fullsized":"2024-09-16T17:05:58.061860+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.084460+0000","last_change":"2024-09-16T16:52:04.725681+0000","last_active":"2024-09-16T17:05:58.084460+0000","last_peered":"2024-09-16T17:05:58.084460+0000","last_clean":"2024-09-16T17:05:58.084460+0000","last_became_active":"2024-09-16T16:52:04.716567+0000","last_became_peered":"2024-09-16T16:52:04.716567+0000","last_unstale":"2024-09-16T17:05:58.084460+0000","last_undegraded":"2024-09-16T17:05:58.084460+0000","last_fullsized":"2024-09-16T17:05:58.084460+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.110233+0000","last_change":"2024-09-16T16:52:04.848189+0000","last_active":"2024-09-16T17:05:58.110233+0000","last_peered":"2024-09-16T17:05:58.110233+0000","last_clean":"2024-09-16T17:05:58.110233+0000","last_became_active":"2024-09-16T16:52:04.840298+0000","last_became_peered":"2024-09-16T16:52:04.840298+0000","last_unstale":"2024-09-16T17:05:58.110233+0000","last_undegraded":"2024-09-16T17:05:58.110233+0000","last_fullsized":"2024-09-16T17:05:58.110233+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.077131+0000","last_change":"2024-09-16T16:52:04.756769+0000","last_active":"2024-09-16T17:05:58.077131+0000","last_peered":"2024-09-16T17:05:58.077131+0000","last_clean":"2024-09-16T17:05:58.077131+0000","last_became_active":"2024-09-16T16:52:04.751100+0000","last_became_peered":"2024-09-16T16:52:04.751100+0000","last_unstale":"2024-09-16T17:05:58.077131+0000","last_undegraded":"2024-09-16T17:05:58.077131+0000","last_fullsized":"2024-09-16T17:05:58.077131+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.107487+0000","last_change":"2024-09-16T16:52:04.797030+0000","last_active":"2024-09-16T17:05:58.107487+0000","last_peered":"2024-09-16T17:05:58.107487+0000","last_clean":"2024-09-16T17:05:58.107487+0000","last_became_active":"2024-09-16T16:52:04.789190+0000","last_became_peered":"2024-09-16T16:52:04.789190+0000","last_unstale":"2024-09-16T17:05:58.107487+0000","last_undegraded":"2024-09-16T17:05:58.107487+0000","last_fullsized":"2024-09-16T17:05:58.107487+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.104216+0000","last_change":"2024-09-16T16:52:04.818516+0000","last_active":"2024-09-16T17:05:58.104216+0000","last_peered":"2024-09-16T17:05:58.104216+0000","last_clean":"2024-09-16T17:05:58.104216+0000","last_became_active":"2024-09-16T16:52:04.805951+0000","last_became_peered":"2024-09-16T16:52:04.805951+0000","last_unstale":"2024-09-16T17:05:58.104216+0000","last_undegraded":"2024-09-16T17:05:58.104216+0000","last_fullsized":"2024-09-16T17:05:58.104216+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.082143+0000","last_change":"2024-09-16T16:52:04.747686+0000","last_active":"2024-09-16T17:05:58.082143+0000","last_peered":"2024-09-16T17:05:58.082143+0000","last_clean":"2024-09-16T17:05:58.082143+0000","last_became_active":"2024-09-16T16:52:04.711856+0000","last_became_peered":"2024-09-16T16:52:04.711856+0000","last_unstale":"2024-09-16T17:05:58.082143+0000","last_undegraded":"2024-09-16T17:05:58.082143+0000","last_fullsized":"2024-09-16T17:05:58.082143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1482,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.086194+0000","last_change":"2024-09-16T16:52:04.693250+0000","last_active":"2024-09-16T17:05:58.086194+0000","last_peered":"2024-09-16T17:05:58.086194+0000","last_clean":"2024-09-16T17:05:58.086194+0000","last_became_active":"2024-09-16T16:52:04.671009+0000","last_became_peered":"2024-09-16T16:52:04.671009+0000","last_unstale":"2024-09-16T17:05:58.086194+0000","last_undegraded":"2024-09-16T17:05:58.086194+0000","last_fullsized":"2024-09-16T17:05:58.086194+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.072685+0000","last_change":"2024-09-16T16:52:04.674154+0000","last_active":"2024-09-16T17:05:58.072685+0000","last_peered":"2024-09-16T17:05:58.072685+0000","last_clean":"2024-09-16T17:05:58.072685+0000","last_became_active":"2024-09-16T16:52:04.662483+0000","last_became_peered":"2024-09-16T16:52:04.662483+0000","last_unstale":"2024-09-16T17:05:58.072685+0000","last_undegraded":"2024-09-16T17:05:58.072685+0000","last_fullsized":"2024-09-16T17:05:58.072685+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:03.525608+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.061054+0000","last_change":"2024-09-16T16:47:04.775431+0000","last_active":"2024-09-16T17:05:58.061054+0000","last_peered":"2024-09-16T17:05:58.061054+0000","last_clean":"2024-09-16T17:05:58.061054+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T17:05:58.061054+0000","last_undegraded":"2024-09-16T17:05:58.061054+0000","last_fullsized":"2024-09-16T17:05:58.061054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.073207+0000","last_change":"2024-09-16T16:47:04.773201+0000","last_active":"2024-09-16T17:05:58.073207+0000","last_peered":"2024-09-16T17:05:58.073207+0000","last_clean":"2024-09-16T17:05:58.073207+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T17:05:58.073207+0000","last_undegraded":"2024-09-16T17:05:58.073207+0000","last_fullsized":"2024-09-16T17:05:58.073207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.077878+0000","last_change":"2024-09-16T16:47:04.773098+0000","last_active":"2024-09-16T17:05:58.077878+0000","last_peered":"2024-09-16T17:05:58.077878+0000","last_clean":"2024-09-16T17:05:58.077878+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T17:05:58.077878+0000","last_undegraded":"2024-09-16T17:05:58.077878+0000","last_fullsized":"2024-09-16T17:05:58.077878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.060345+0000","last_change":"2024-09-16T16:47:04.772539+0000","last_active":"2024-09-16T17:05:58.060345+0000","last_peered":"2024-09-16T17:05:58.060345+0000","last_clean":"2024-09-16T17:05:58.060345+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T17:05:58.060345+0000","last_undegraded":"2024-09-16T17:05:58.060345+0000","last_fullsized":"2024-09-16T17:05:58.060345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.108309+0000","last_change":"2024-09-16T16:47:04.775258+0000","last_active":"2024-09-16T17:05:58.108309+0000","last_peered":"2024-09-16T17:05:58.108309+0000","last_clean":"2024-09-16T17:05:58.108309+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T17:05:58.108309+0000","last_undegraded":"2024-09-16T17:05:58.108309+0000","last_fullsized":"2024-09-16T17:05:58.108309+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.061885+0000","last_change":"2024-09-16T16:47:04.776043+0000","last_active":"2024-09-16T17:05:58.061885+0000","last_peered":"2024-09-16T17:05:58.061885+0000","last_clean":"2024-09-16T17:05:58.061885+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T17:05:58.061885+0000","last_undegraded":"2024-09-16T17:05:58.061885+0000","last_fullsized":"2024-09-16T17:05:58.061885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.094602+0000","last_change":"2024-09-16T16:47:04.774799+0000","last_active":"2024-09-16T17:05:58.094602+0000","last_peered":"2024-09-16T17:05:58.094602+0000","last_clean":"2024-09-16T17:05:58.094602+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T17:05:58.094602+0000","last_undegraded":"2024-09-16T17:05:58.094602+0000","last_fullsized":"2024-09-16T17:05:58.094602+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2143,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.087930+0000","last_change":"2024-09-16T16:47:04.778757+0000","last_active":"2024-09-16T17:05:58.087930+0000","last_peered":"2024-09-16T17:05:58.087930+0000","last_clean":"2024-09-16T17:05:58.087930+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T17:05:58.087930+0000","last_undegraded":"2024-09-16T17:05:58.087930+0000","last_fullsized":"2024-09-16T17:05:58.087930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:01.737536+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2211,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:58.062321+0000","last_change":"2024-09-16T16:47:01.810855+0000","last_active":"2024-09-16T17:05:58.062321+0000","last_peered":"2024-09-16T17:05:58.062321+0000","last_clean":"2024-09-16T17:05:58.062321+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T17:05:58.062321+0000","last_undegraded":"2024-09-16T17:05:58.062321+0000","last_fullsized":"2024-09-16T17:05:58.062321+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:00.736625+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70564,"kb_used_data":3476,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301276,"statfs":{"total":96636764160,"available":96564506624,"internally_reserved":0,"allocated":3559424,"data_stored":1937411,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66352,"kb_used_data":3424,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305488,"statfs":{"total":96636764160,"available":96568819712,"internally_reserved":0,"allocated":3506176,"data_stored":1347067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949674099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64940,"kb_used_data":3420,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3502080,"data_stored":1347048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60840,"kb_used_data":3480,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311000,"statfs":{"total":96636764160,"available":96574464000,"internally_reserved":0,"allocated":3563520,"data_stored":1937430,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:23.752 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.752 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.753 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.754 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.755 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-16T16:52:03.525608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.756 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.757 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.757 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:47:01.737536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=1, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.757 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:47:00.736625+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=47, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:23.757 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:06:43.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.883+0000 7f143d6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.888+0000 7f143d6d1640 1 Processor -- start 2024-09-16T17:06:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.888+0000 7f143d6d1640 1 -- start start 2024-09-16T17:06:43.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.889+0000 7f143d6d1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f143809b470 0x7f143809b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:43.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f143d6d1640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143809f420 con 0x7f1438132980 2024-09-16T17:06:43.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f143d6d1640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1438075380 con 0x7f143809b470 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1436ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f143809b470 0x7f143809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f14367fc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1438132980 0x7f1438132d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57072/0 (socket says 172.21.15.59:57072) 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1436ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f143809b470 0x7f143809b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42108/0 (socket says 172.21.15.59:42108) 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f14367fc640 1 -- 172.21.15.59:0/1328305573 learned_addr learned my addr 172.21.15.59:0/1328305573 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1436ffd640 1 -- 172.21.15.59:0/1328305573 >> v1:172.21.15.59:6789/0 conn(0x7f1438132980 legacy=0x7f1438132d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1436ffd640 1 -- 172.21.15.59:0/1328305573 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143806d370 con 0x7f143809b470 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1436ffd640 1 --2- 172.21.15.59:0/1328305573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f143809b880 crc :-1 s=READY pgs=13028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa02b8f7abe524 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1435ffb640 1 -- 172.21.15.59:0/1328305573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f142800e040 con 0x7f143809b470 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1435ffb640 1 -- 172.21.15.59:0/1328305573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1428007670 con 0x7f143809b470 2024-09-16T17:06:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.890+0000 7f1435ffb640 1 -- 172.21.15.59:0/1328305573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1428007910 con 0x7f143809b470 2024-09-16T17:06:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 -- 172.21.15.59:0/1328305573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 msgr2=0x7f143809b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 --2- 172.21.15.59:0/1328305573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f143809b880 crc :-1 s=READY pgs=13028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 -- 172.21.15.59:0/1328305573 shutdown_connections 2024-09-16T17:06:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 --2- 172.21.15.59:0/1328305573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f143809b880 unknown :-1 s=CLOSED pgs=13028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 -- 172.21.15.59:0/1328305573 >> 172.21.15.59:0/1328305573 conn(0x7f14380a32a0 msgr2=0x7f14380a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 -- 172.21.15.59:0/1328305573 shutdown_connections 2024-09-16T17:06:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.891+0000 7f143d6d1640 1 -- 172.21.15.59:0/1328305573 wait complete. 2024-09-16T17:06:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.892+0000 7f143d6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.893+0000 7f143d6d1640 1 Processor -- start 2024-09-16T17:06:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.894+0000 7f143d6d1640 1 -- start start 2024-09-16T17:06:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.895+0000 7f143d6d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f14381c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.895+0000 7f143d6d1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f143808e6c0 con 0x7f143809b470 2024-09-16T17:06:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.895+0000 7f1436ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f14381c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:43.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.895+0000 7f1436ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f14381c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42118/0 (socket says 172.21.15.59:42118) 2024-09-16T17:06:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.895+0000 7f1436ffd640 1 -- 172.21.15.59:0/4137108556 learned_addr learned my addr 172.21.15.59:0/4137108556 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f1436ffd640 1 -- 172.21.15.59:0/4137108556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14380a12e0 con 0x7f143809b470 2024-09-16T17:06:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f1436ffd640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f14381c7dd0 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:43.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f142800e040 con 0x7f143809b470 2024-09-16T17:06:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1428012a90 con 0x7f143809b470 2024-09-16T17:06:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143812fe70 con 0x7f143809b470 2024-09-16T17:06:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1428012d30 con 0x7f143809b470 2024-09-16T17:06:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.896+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143812fba0 con 0x7f143809b470 2024-09-16T17:06:43.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.897+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f14280153f0 con 0x7f143809b470 2024-09-16T17:06:43.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.897+0000 7f141f7fe640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f142403e930 0x7f1424040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:43.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.897+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143809b880 con 0x7f143809b470 2024-09-16T17:06:43.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.897+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7f1428051160 con 0x7f143809b470 2024-09-16T17:06:43.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.898+0000 7f14367fc640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f142403e930 0x7f1424040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:43.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.898+0000 7f14367fc640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f142403e930 0x7f1424040e40 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:43.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:43.903+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1428014710 con 0x7f143809b470 2024-09-16T17:06:44.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.085+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 --> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f143809fb70 con 0x7f142403e930 2024-09-16T17:06:44.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.088+0000 7f141f7fe640 1 -- 172.21.15.59:0/4137108556 <== mgr.4100 v2:172.21.15.104:6800/3532556748 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109198 (crc 0 0 0) 0x7f142c005910 con 0x7f142403e930 2024-09-16T17:06:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-16T17:06:44.090 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-16T17:06:44.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f142403e930 msgr2=0x7f1424040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:44.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f142403e930 0x7f1424040e40 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 msgr2=0x7f14381c7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:44.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f14381c7dd0 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 shutdown_connections 2024-09-16T17:06:44.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7f142403e930 0x7f1424040e40 unknown :-1 s=CLOSED pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 --2- 172.21.15.59:0/4137108556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f143809b470 0x7f14381c7dd0 unknown :-1 s=CLOSED pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 >> 172.21.15.59:0/4137108556 conn(0x7f14380a32a0 msgr2=0x7f14380a1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:44.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 shutdown_connections 2024-09-16T17:06:44.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.090+0000 7f143d6d1640 1 -- 172.21.15.59:0/4137108556 wait complete. 2024-09-16T17:06:44.103 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":1309,"stamp":"2024-09-16T17:06:43.991926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":262696,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377224664,"statfs":{"total":386547056640,"available":386278055936,"internally_reserved":0,"allocated":14131200,"data_stored":6568956,"data_compressed":60086,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003041"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.088231+0000","last_change":"2024-09-16T17:06:02.104034+0000","last_active":"2024-09-16T17:06:02.088231+0000","last_peered":"2024-09-16T17:06:02.088231+0000","last_clean":"2024-09-16T17:06:02.088231+0000","last_became_active":"2024-09-16T16:52:04.683267+0000","last_became_peered":"2024-09-16T16:52:04.683267+0000","last_unstale":"2024-09-16T17:06:02.088231+0000","last_undegraded":"2024-09-16T17:06:02.088231+0000","last_fullsized":"2024-09-16T17:06:02.088231+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.103668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.103668+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.587819+0000","last_change":"2024-09-16T17:06:01.601218+0000","last_active":"2024-09-16T17:06:01.587819+0000","last_peered":"2024-09-16T17:06:01.587819+0000","last_clean":"2024-09-16T17:06:01.587819+0000","last_became_active":"2024-09-16T16:52:04.744118+0000","last_became_peered":"2024-09-16T16:52:04.744118+0000","last_unstale":"2024-09-16T17:06:01.587819+0000","last_undegraded":"2024-09-16T17:06:01.587819+0000","last_fullsized":"2024-09-16T17:06:01.587819+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.601051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.601051+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.576273+0000","last_change":"2024-09-16T17:06:02.591991+0000","last_active":"2024-09-16T17:06:02.576273+0000","last_peered":"2024-09-16T17:06:02.576273+0000","last_clean":"2024-09-16T17:06:02.576273+0000","last_became_active":"2024-09-16T16:52:04.659260+0000","last_became_peered":"2024-09-16T16:52:04.659260+0000","last_unstale":"2024-09-16T17:06:02.576273+0000","last_undegraded":"2024-09-16T17:06:02.576273+0000","last_fullsized":"2024-09-16T17:06:02.576273+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.591789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.591789+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.072341+0000","last_change":"2024-09-16T17:06:03.101860+0000","last_active":"2024-09-16T17:06:03.072341+0000","last_peered":"2024-09-16T17:06:03.072341+0000","last_clean":"2024-09-16T17:06:03.072341+0000","last_became_active":"2024-09-16T16:52:04.707958+0000","last_became_peered":"2024-09-16T16:52:04.707958+0000","last_unstale":"2024-09-16T17:06:03.072341+0000","last_undegraded":"2024-09-16T17:06:03.072341+0000","last_fullsized":"2024-09-16T17:06:03.072341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.101693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.101693+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.085190+0000","last_change":"2024-09-16T17:06:02.111930+0000","last_active":"2024-09-16T17:06:02.085190+0000","last_peered":"2024-09-16T17:06:02.085190+0000","last_clean":"2024-09-16T17:06:02.085190+0000","last_became_active":"2024-09-16T16:52:04.655240+0000","last_became_peered":"2024-09-16T16:52:04.655240+0000","last_unstale":"2024-09-16T17:06:02.085190+0000","last_undegraded":"2024-09-16T17:06:02.085190+0000","last_fullsized":"2024-09-16T17:06:02.085190+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.111752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.111752+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.584445+0000","last_change":"2024-09-16T17:06:01.599780+0000","last_active":"2024-09-16T17:06:01.584445+0000","last_peered":"2024-09-16T17:06:01.584445+0000","last_clean":"2024-09-16T17:06:01.584445+0000","last_became_active":"2024-09-16T16:52:04.655040+0000","last_became_peered":"2024-09-16T16:52:04.655040+0000","last_unstale":"2024-09-16T17:06:01.584445+0000","last_undegraded":"2024-09-16T17:06:01.584445+0000","last_fullsized":"2024-09-16T17:06:01.584445+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.599610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.599610+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.590065+0000","last_change":"2024-09-16T17:06:01.608167+0000","last_active":"2024-09-16T17:06:01.590065+0000","last_peered":"2024-09-16T17:06:01.590065+0000","last_clean":"2024-09-16T17:06:01.590065+0000","last_became_active":"2024-09-16T16:52:04.822727+0000","last_became_peered":"2024-09-16T16:52:04.822727+0000","last_unstale":"2024-09-16T17:06:01.590065+0000","last_undegraded":"2024-09-16T17:06:01.590065+0000","last_fullsized":"2024-09-16T17:06:01.590065+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.608001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.608001+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.583620+0000","last_change":"2024-09-16T17:06:01.600450+0000","last_active":"2024-09-16T17:06:01.583620+0000","last_peered":"2024-09-16T17:06:01.583620+0000","last_clean":"2024-09-16T17:06:01.583620+0000","last_became_active":"2024-09-16T16:52:04.749230+0000","last_became_peered":"2024-09-16T16:52:04.749230+0000","last_unstale":"2024-09-16T17:06:01.583620+0000","last_undegraded":"2024-09-16T17:06:01.583620+0000","last_fullsized":"2024-09-16T17:06:01.583620+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.600281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.600281+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.068304+0000","last_change":"2024-09-16T17:06:03.101340+0000","last_active":"2024-09-16T17:06:03.068304+0000","last_peered":"2024-09-16T17:06:03.068304+0000","last_clean":"2024-09-16T17:06:03.068304+0000","last_became_active":"2024-09-16T16:52:04.722821+0000","last_became_peered":"2024-09-16T16:52:04.722821+0000","last_unstale":"2024-09-16T17:06:03.068304+0000","last_undegraded":"2024-09-16T17:06:03.068304+0000","last_fullsized":"2024-09-16T17:06:03.068304+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.101113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.101113+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.572128+0000","last_change":"2024-09-16T17:06:02.588827+0000","last_active":"2024-09-16T17:06:02.572128+0000","last_peered":"2024-09-16T17:06:02.572128+0000","last_clean":"2024-09-16T17:06:02.572128+0000","last_became_active":"2024-09-16T16:52:04.628000+0000","last_became_peered":"2024-09-16T16:52:04.628000+0000","last_unstale":"2024-09-16T17:06:02.572128+0000","last_undegraded":"2024-09-16T17:06:02.572128+0000","last_fullsized":"2024-09-16T17:06:02.572128+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.588661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.588661+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.070381+0000","last_change":"2024-09-16T17:06:03.096983+0000","last_active":"2024-09-16T17:06:03.070381+0000","last_peered":"2024-09-16T17:06:03.070381+0000","last_clean":"2024-09-16T17:06:03.070381+0000","last_became_active":"2024-09-16T16:52:04.660722+0000","last_became_peered":"2024-09-16T16:52:04.660722+0000","last_unstale":"2024-09-16T17:06:03.070381+0000","last_undegraded":"2024-09-16T17:06:03.070381+0000","last_fullsized":"2024-09-16T17:06:03.070381+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.096783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.096783+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.582254+0000","last_change":"2024-09-16T17:06:01.597191+0000","last_active":"2024-09-16T17:06:01.582254+0000","last_peered":"2024-09-16T17:06:01.582254+0000","last_clean":"2024-09-16T17:06:01.582254+0000","last_became_active":"2024-09-16T16:52:04.705911+0000","last_became_peered":"2024-09-16T16:52:04.705911+0000","last_unstale":"2024-09-16T17:06:01.582254+0000","last_undegraded":"2024-09-16T17:06:01.582254+0000","last_fullsized":"2024-09-16T17:06:01.582254+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.597012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.597012+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.063300+0000","last_change":"2024-09-16T17:06:03.094203+0000","last_active":"2024-09-16T17:06:03.063300+0000","last_peered":"2024-09-16T17:06:03.063300+0000","last_clean":"2024-09-16T17:06:03.063300+0000","last_became_active":"2024-09-16T16:52:04.711500+0000","last_became_peered":"2024-09-16T16:52:04.711500+0000","last_unstale":"2024-09-16T17:06:03.063300+0000","last_undegraded":"2024-09-16T17:06:03.063300+0000","last_fullsized":"2024-09-16T17:06:03.063300+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.094023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.094023+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.059490+0000","last_change":"2024-09-16T17:06:03.081141+0000","last_active":"2024-09-16T17:06:03.059490+0000","last_peered":"2024-09-16T17:06:03.059490+0000","last_clean":"2024-09-16T17:06:03.059490+0000","last_became_active":"2024-09-16T16:52:04.784535+0000","last_became_peered":"2024-09-16T16:52:04.784535+0000","last_unstale":"2024-09-16T17:06:03.059490+0000","last_undegraded":"2024-09-16T17:06:03.059490+0000","last_fullsized":"2024-09-16T17:06:03.059490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.080813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.080813+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.587023+0000","last_change":"2024-09-16T17:06:01.605973+0000","last_active":"2024-09-16T17:06:01.587023+0000","last_peered":"2024-09-16T17:06:01.587023+0000","last_clean":"2024-09-16T17:06:01.587023+0000","last_became_active":"2024-09-16T16:52:04.727116+0000","last_became_peered":"2024-09-16T16:52:04.727116+0000","last_unstale":"2024-09-16T17:06:01.587023+0000","last_undegraded":"2024-09-16T17:06:01.587023+0000","last_fullsized":"2024-09-16T17:06:01.587023+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.605792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.605792+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.585319+0000","last_change":"2024-09-16T17:06:01.604733+0000","last_active":"2024-09-16T17:06:01.585319+0000","last_peered":"2024-09-16T17:06:01.585319+0000","last_clean":"2024-09-16T17:06:01.585319+0000","last_became_active":"2024-09-16T16:52:04.814429+0000","last_became_peered":"2024-09-16T16:52:04.814429+0000","last_unstale":"2024-09-16T17:06:01.585319+0000","last_undegraded":"2024-09-16T17:06:01.585319+0000","last_fullsized":"2024-09-16T17:06:01.585319+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.604523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.604523+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.582657+0000","last_change":"2024-09-16T17:06:01.607390+0000","last_active":"2024-09-16T17:06:01.582657+0000","last_peered":"2024-09-16T17:06:01.582657+0000","last_clean":"2024-09-16T17:06:01.582657+0000","last_became_active":"2024-09-16T16:52:04.704696+0000","last_became_peered":"2024-09-16T16:52:04.704696+0000","last_unstale":"2024-09-16T17:06:01.582657+0000","last_undegraded":"2024-09-16T17:06:01.582657+0000","last_fullsized":"2024-09-16T17:06:01.582657+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.607220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.607220+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.060172+0000","last_change":"2024-09-16T17:06:03.095727+0000","last_active":"2024-09-16T17:06:03.060172+0000","last_peered":"2024-09-16T17:06:03.060172+0000","last_clean":"2024-09-16T17:06:03.060172+0000","last_became_active":"2024-09-16T16:52:04.668455+0000","last_became_peered":"2024-09-16T16:52:04.668455+0000","last_unstale":"2024-09-16T17:06:03.060172+0000","last_undegraded":"2024-09-16T17:06:03.060172+0000","last_fullsized":"2024-09-16T17:06:03.060172+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.095567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.095567+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.570582+0000","last_change":"2024-09-16T17:06:02.586810+0000","last_active":"2024-09-16T17:06:02.570582+0000","last_peered":"2024-09-16T17:06:02.570582+0000","last_clean":"2024-09-16T17:06:02.570582+0000","last_became_active":"2024-09-16T16:52:04.647610+0000","last_became_peered":"2024-09-16T16:52:04.647610+0000","last_unstale":"2024-09-16T17:06:02.570582+0000","last_undegraded":"2024-09-16T17:06:02.570582+0000","last_fullsized":"2024-09-16T17:06:02.570582+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.586632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.586632+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.085728+0000","last_change":"2024-09-16T17:06:02.114011+0000","last_active":"2024-09-16T17:06:02.085728+0000","last_peered":"2024-09-16T17:06:02.085728+0000","last_clean":"2024-09-16T17:06:02.085728+0000","last_became_active":"2024-09-16T16:52:04.755722+0000","last_became_peered":"2024-09-16T16:52:04.755722+0000","last_unstale":"2024-09-16T17:06:02.085728+0000","last_undegraded":"2024-09-16T17:06:02.085728+0000","last_fullsized":"2024-09-16T17:06:02.085728+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.113683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.113683+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.083944+0000","last_change":"2024-09-16T17:06:02.111791+0000","last_active":"2024-09-16T17:06:02.083944+0000","last_peered":"2024-09-16T17:06:02.083944+0000","last_clean":"2024-09-16T17:06:02.083944+0000","last_became_active":"2024-09-16T16:52:04.791745+0000","last_became_peered":"2024-09-16T16:52:04.791745+0000","last_unstale":"2024-09-16T17:06:02.083944+0000","last_undegraded":"2024-09-16T17:06:02.083944+0000","last_fullsized":"2024-09-16T17:06:02.083944+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.111499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.111499+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.081574+0000","last_change":"2024-09-16T17:06:02.109363+0000","last_active":"2024-09-16T17:06:02.081574+0000","last_peered":"2024-09-16T17:06:02.081574+0000","last_clean":"2024-09-16T17:06:02.081574+0000","last_became_active":"2024-09-16T16:52:04.686232+0000","last_became_peered":"2024-09-16T16:52:04.686232+0000","last_unstale":"2024-09-16T17:06:02.081574+0000","last_undegraded":"2024-09-16T17:06:02.081574+0000","last_fullsized":"2024-09-16T17:06:02.081574+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.109187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.109187+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.572638+0000","last_change":"2024-09-16T17:06:02.590960+0000","last_active":"2024-09-16T17:06:02.572638+0000","last_peered":"2024-09-16T17:06:02.572638+0000","last_clean":"2024-09-16T17:06:02.572638+0000","last_became_active":"2024-09-16T16:52:04.674267+0000","last_became_peered":"2024-09-16T16:52:04.674267+0000","last_unstale":"2024-09-16T17:06:02.572638+0000","last_undegraded":"2024-09-16T17:06:02.572638+0000","last_fullsized":"2024-09-16T17:06:02.572638+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.590765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.590765+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.057145+0000","last_change":"2024-09-16T17:06:03.087137+0000","last_active":"2024-09-16T17:06:03.057145+0000","last_peered":"2024-09-16T17:06:03.057145+0000","last_clean":"2024-09-16T17:06:03.057145+0000","last_became_active":"2024-09-16T16:52:04.651245+0000","last_became_peered":"2024-09-16T16:52:04.651245+0000","last_unstale":"2024-09-16T17:06:03.057145+0000","last_undegraded":"2024-09-16T17:06:03.057145+0000","last_fullsized":"2024-09-16T17:06:03.057145+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.086944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.086944+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.057137+0000","last_change":"2024-09-16T17:06:03.099268+0000","last_active":"2024-09-16T17:06:03.057137+0000","last_peered":"2024-09-16T17:06:03.057137+0000","last_clean":"2024-09-16T17:06:03.057137+0000","last_became_active":"2024-09-16T16:52:04.716567+0000","last_became_peered":"2024-09-16T16:52:04.716567+0000","last_unstale":"2024-09-16T17:06:03.057137+0000","last_undegraded":"2024-09-16T17:06:03.057137+0000","last_fullsized":"2024-09-16T17:06:03.057137+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.099097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.099097+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.581669+0000","last_change":"2024-09-16T17:06:01.603227+0000","last_active":"2024-09-16T17:06:01.581669+0000","last_peered":"2024-09-16T17:06:01.581669+0000","last_clean":"2024-09-16T17:06:01.581669+0000","last_became_active":"2024-09-16T16:52:04.840298+0000","last_became_peered":"2024-09-16T16:52:04.840298+0000","last_unstale":"2024-09-16T17:06:01.581669+0000","last_undegraded":"2024-09-16T17:06:01.581669+0000","last_fullsized":"2024-09-16T17:06:01.581669+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.602929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.602929+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.058300+0000","last_change":"2024-09-16T17:06:03.087145+0000","last_active":"2024-09-16T17:06:03.058300+0000","last_peered":"2024-09-16T17:06:03.058300+0000","last_clean":"2024-09-16T17:06:03.058300+0000","last_became_active":"2024-09-16T16:52:04.751100+0000","last_became_peered":"2024-09-16T16:52:04.751100+0000","last_unstale":"2024-09-16T17:06:03.058300+0000","last_undegraded":"2024-09-16T17:06:03.058300+0000","last_fullsized":"2024-09-16T17:06:03.058300+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.086973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.086973+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.578637+0000","last_change":"2024-09-16T17:06:01.596522+0000","last_active":"2024-09-16T17:06:01.578637+0000","last_peered":"2024-09-16T17:06:01.578637+0000","last_clean":"2024-09-16T17:06:01.578637+0000","last_became_active":"2024-09-16T16:52:04.789190+0000","last_became_peered":"2024-09-16T16:52:04.789190+0000","last_unstale":"2024-09-16T17:06:01.578637+0000","last_undegraded":"2024-09-16T17:06:01.578637+0000","last_fullsized":"2024-09-16T17:06:01.578637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.596214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.596214+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.578671+0000","last_change":"2024-09-16T17:06:01.598918+0000","last_active":"2024-09-16T17:06:01.578671+0000","last_peered":"2024-09-16T17:06:01.578671+0000","last_clean":"2024-09-16T17:06:01.578671+0000","last_became_active":"2024-09-16T16:52:04.805951+0000","last_became_peered":"2024-09-16T16:52:04.805951+0000","last_unstale":"2024-09-16T17:06:01.578671+0000","last_undegraded":"2024-09-16T17:06:01.578671+0000","last_fullsized":"2024-09-16T17:06:01.578671+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.598650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.598650+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.577368+0000","last_change":"2024-09-16T17:06:01.593551+0000","last_active":"2024-09-16T17:06:01.577368+0000","last_peered":"2024-09-16T17:06:01.577368+0000","last_clean":"2024-09-16T17:06:01.577368+0000","last_became_active":"2024-09-16T16:52:04.711856+0000","last_became_peered":"2024-09-16T16:52:04.711856+0000","last_unstale":"2024-09-16T17:06:01.577368+0000","last_undegraded":"2024-09-16T17:06:01.577368+0000","last_fullsized":"2024-09-16T17:06:01.577368+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.593377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.593377+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1484,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.080711+0000","last_change":"2024-09-16T17:06:02.108481+0000","last_active":"2024-09-16T17:06:02.080711+0000","last_peered":"2024-09-16T17:06:02.080711+0000","last_clean":"2024-09-16T17:06:02.080711+0000","last_became_active":"2024-09-16T16:52:04.671009+0000","last_became_peered":"2024-09-16T16:52:04.671009+0000","last_unstale":"2024-09-16T17:06:02.080711+0000","last_undegraded":"2024-09-16T17:06:02.080711+0000","last_fullsized":"2024-09-16T17:06:02.080711+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-09-16T17:06:02.108155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.108155+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.571543+0000","last_change":"2024-09-16T17:06:02.589911+0000","last_active":"2024-09-16T17:06:02.571543+0000","last_peered":"2024-09-16T17:06:02.571543+0000","last_clean":"2024-09-16T17:06:02.571543+0000","last_became_active":"2024-09-16T16:52:04.662483+0000","last_became_peered":"2024-09-16T16:52:04.662483+0000","last_unstale":"2024-09-16T17:06:02.571543+0000","last_undegraded":"2024-09-16T17:06:02.571543+0000","last_fullsized":"2024-09-16T17:06:02.571543+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.589745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.589745+0000","last_clean_scrub_stamp":"2024-09-16T16:52:03.525608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.079645+0000","last_change":"2024-09-16T17:06:02.107177+0000","last_active":"2024-09-16T17:06:02.079645+0000","last_peered":"2024-09-16T17:06:02.079645+0000","last_clean":"2024-09-16T17:06:02.079645+0000","last_became_active":"2024-09-16T16:47:02.805521+0000","last_became_peered":"2024-09-16T16:47:02.805521+0000","last_unstale":"2024-09-16T17:06:02.079645+0000","last_undegraded":"2024-09-16T17:06:02.079645+0000","last_fullsized":"2024-09-16T17:06:02.079645+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.106954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.106954+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.570412+0000","last_change":"2024-09-16T17:06:02.587085+0000","last_active":"2024-09-16T17:06:02.570412+0000","last_peered":"2024-09-16T17:06:02.570412+0000","last_clean":"2024-09-16T17:06:02.570412+0000","last_became_active":"2024-09-16T16:47:02.813249+0000","last_became_peered":"2024-09-16T16:47:02.813249+0000","last_unstale":"2024-09-16T17:06:02.570412+0000","last_undegraded":"2024-09-16T17:06:02.570412+0000","last_fullsized":"2024-09-16T17:06:02.570412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.586870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.586870+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.057366+0000","last_change":"2024-09-16T17:06:03.092720+0000","last_active":"2024-09-16T17:06:03.057366+0000","last_peered":"2024-09-16T17:06:03.057366+0000","last_clean":"2024-09-16T17:06:03.057366+0000","last_became_active":"2024-09-16T16:47:02.799356+0000","last_became_peered":"2024-09-16T16:47:02.799356+0000","last_unstale":"2024-09-16T17:06:03.057366+0000","last_undegraded":"2024-09-16T17:06:03.057366+0000","last_fullsized":"2024-09-16T17:06:03.057366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:03.092538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.092538+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.568072+0000","last_change":"2024-09-16T17:06:02.582565+0000","last_active":"2024-09-16T17:06:02.568072+0000","last_peered":"2024-09-16T17:06:02.568072+0000","last_clean":"2024-09-16T17:06:02.568072+0000","last_became_active":"2024-09-16T16:47:02.792533+0000","last_became_peered":"2024-09-16T16:47:02.792533+0000","last_unstale":"2024-09-16T17:06:02.568072+0000","last_undegraded":"2024-09-16T17:06:02.568072+0000","last_fullsized":"2024-09-16T17:06:02.568072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.582219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.582219+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2146,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.577226+0000","last_change":"2024-09-16T17:06:01.609751+0000","last_active":"2024-09-16T17:06:01.577226+0000","last_peered":"2024-09-16T17:06:01.577226+0000","last_clean":"2024-09-16T17:06:01.577226+0000","last_became_active":"2024-09-16T16:47:02.796051+0000","last_became_peered":"2024-09-16T16:47:02.796051+0000","last_unstale":"2024-09-16T17:06:01.577226+0000","last_undegraded":"2024-09-16T17:06:01.577226+0000","last_fullsized":"2024-09-16T17:06:01.577226+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-16T17:06:01.609544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.609544+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.077707+0000","last_change":"2024-09-16T17:06:02.096955+0000","last_active":"2024-09-16T17:06:02.077707+0000","last_peered":"2024-09-16T17:06:02.077707+0000","last_clean":"2024-09-16T17:06:02.077707+0000","last_became_active":"2024-09-16T16:47:02.795375+0000","last_became_peered":"2024-09-16T16:47:02.795375+0000","last_unstale":"2024-09-16T17:06:02.077707+0000","last_undegraded":"2024-09-16T17:06:02.077707+0000","last_fullsized":"2024-09-16T17:06:02.077707+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:02.096661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.096661+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:01.577222+0000","last_change":"2024-09-16T17:06:01.592270+0000","last_active":"2024-09-16T17:06:01.577222+0000","last_peered":"2024-09-16T17:06:01.577222+0000","last_clean":"2024-09-16T17:06:01.577222+0000","last_became_active":"2024-09-16T16:47:02.817409+0000","last_became_peered":"2024-09-16T16:47:02.817409+0000","last_unstale":"2024-09-16T17:06:01.577222+0000","last_undegraded":"2024-09-16T17:06:01.577222+0000","last_fullsized":"2024-09-16T17:06:01.577222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:01.592094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:01.592094+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2145,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:02.078968+0000","last_change":"2024-09-16T17:06:02.115252+0000","last_active":"2024-09-16T17:06:02.078968+0000","last_peered":"2024-09-16T17:06:02.078968+0000","last_clean":"2024-09-16T17:06:02.078968+0000","last_became_active":"2024-09-16T16:47:02.824954+0000","last_became_peered":"2024-09-16T16:47:02.824954+0000","last_unstale":"2024-09-16T17:06:02.078968+0000","last_undegraded":"2024-09-16T17:06:02.078968+0000","last_fullsized":"2024-09-16T17:06:02.078968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T17:06:02.115063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:02.115063+0000","last_clean_scrub_stamp":"2024-09-16T16:47:01.737536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2213,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:06:03.054876+0000","last_change":"2024-09-16T17:06:03.100033+0000","last_active":"2024-09-16T17:06:03.054876+0000","last_peered":"2024-09-16T17:06:03.054876+0000","last_clean":"2024-09-16T17:06:03.054876+0000","last_became_active":"2024-09-16T16:47:01.804120+0000","last_became_peered":"2024-09-16T16:47:01.804120+0000","last_unstale":"2024-09-16T17:06:03.054876+0000","last_undegraded":"2024-09-16T17:06:03.054876+0000","last_fullsized":"2024-09-16T17:06:03.054876+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-16T17:06:03.099810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:03.099810+0000","last_clean_scrub_stamp":"2024-09-16T16:47:00.736625+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70564,"kb_used_data":3476,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301276,"statfs":{"total":96636764160,"available":96564506624,"internally_reserved":0,"allocated":3559424,"data_stored":1937411,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66352,"kb_used_data":3424,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305488,"statfs":{"total":96636764160,"available":96568819712,"internally_reserved":0,"allocated":3506176,"data_stored":1347067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949674129,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64940,"kb_used_data":3420,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3502080,"data_stored":1347048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60840,"kb_used_data":3480,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94311000,"statfs":{"total":96636764160,"available":96574464000,"internally_reserved":0,"allocated":3563520,"data_stored":1937430,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30043,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:44.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T17:06:44.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.210+0000 7fe1db551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:44.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.218+0000 7fe1db551640 1 Processor -- start 2024-09-16T17:06:44.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.219+0000 7fe1db551640 1 -- start start 2024-09-16T17:06:44.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1db551640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d409b470 0x7fe1d409b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:44.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1db551640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d406d6b0 con 0x7fe1d4132a10 2024-09-16T17:06:44.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1db551640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d409e7c0 con 0x7fe1d409b470 2024-09-16T17:06:44.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1d92ed640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d409b470 0x7fe1d409b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:44.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1d8aec640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe1d4132a10 0x7fe1d4132e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57082/0 (socket says 172.21.15.59:57082) 2024-09-16T17:06:44.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1d8aec640 1 -- 172.21.15.59:0/648371708 learned_addr learned my addr 172.21.15.59:0/648371708 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-09-16T17:06:44.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.220+0000 7fe1d92ed640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d409b470 0x7fe1d409b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42130/0 (socket says 172.21.15.59:42130) 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1d92ed640 1 -- 172.21.15.59:0/648371708 >> v1:172.21.15.59:6789/0 conn(0x7fe1d4132a10 legacy=0x7fe1d4132e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1d92ed640 1 -- 172.21.15.59:0/648371708 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d409ea50 con 0x7fe1d409b470 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1cbfff640 1 -- 172.21.15.59:0/648371708 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189725843 0 0) 0x7fe1d406d6b0 con 0x7fe1d4132a10 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1d92ed640 1 --2- 172.21.15.59:0/648371708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409b880 crc :-1 s=READY pgs=13031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2d09b330fd0d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1cbfff640 1 -- 172.21.15.59:0/648371708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1d0009d90 con 0x7fe1d409b470 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1cbfff640 1 -- 172.21.15.59:0/648371708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe1d000e230 con 0x7fe1d409b470 2024-09-16T17:06:44.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.221+0000 7fe1cbfff640 1 -- 172.21.15.59:0/648371708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1d000e4d0 con 0x7fe1d409b470 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 -- 172.21.15.59:0/648371708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 msgr2=0x7fe1d409b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 --2- 172.21.15.59:0/648371708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409b880 crc :-1 s=READY pgs=13031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 -- 172.21.15.59:0/648371708 shutdown_connections 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 --2- 172.21.15.59:0/648371708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409b880 unknown :-1 s=CLOSED pgs=13031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 -- 172.21.15.59:0/648371708 >> 172.21.15.59:0/648371708 conn(0x7fe1d40a3330 msgr2=0x7fe1d40a3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 -- 172.21.15.59:0/648371708 shutdown_connections 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 1 -- 172.21.15.59:0/648371708 wait complete. 2024-09-16T17:06:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.222+0000 7fe1db551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:44.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.224+0000 7fe1db551640 1 Processor -- start 2024-09-16T17:06:44.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.224+0000 7fe1db551640 1 -- start start 2024-09-16T17:06:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1db551640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1db551640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d412f5a0 con 0x7fe1d409b470 2024-09-16T17:06:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1d92ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1d92ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42132/0 (socket says 172.21.15.59:42132) 2024-09-16T17:06:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1d92ed640 1 -- 172.21.15.59:0/29689956 learned_addr learned my addr 172.21.15.59:0/29689956 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1d92ed640 1 -- 172.21.15.59:0/29689956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40695e0 con 0x7fe1d409b470 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1d92ed640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409a470 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1d0013610 con 0x7fe1d409b470 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe1d0013770 con 0x7fe1d409b470 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d40a1060 con 0x7fe1d409b470 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.226+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1d0013a10 con 0x7fe1d409b470 2024-09-16T17:06:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.227+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d4068fa0 con 0x7fe1d409b470 2024-09-16T17:06:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.227+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe1d0013bc0 con 0x7fe1d409b470 2024-09-16T17:06:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.228+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d409b880 con 0x7fe1d409b470 2024-09-16T17:06:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.228+0000 7fe1c9ffb640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe1b803e930 0x7fe1b8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.228+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(724..724 src has 403..724) ==== 3431+0+0 (crc 0 0 0) 0x7fe1d0018040 con 0x7fe1d409b470 2024-09-16T17:06:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.228+0000 7fe1d8aec640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe1b803e930 0x7fe1b8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.229+0000 7fe1d8aec640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe1b803e930 0x7fe1b8040e40 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:44.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.233+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe1d0011380 con 0x7fe1d409b470 2024-09-16T17:06:44.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.419+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe1d406c3b0 con 0x7fe1d409b470 2024-09-16T17:06:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.425+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7fe1d0018a50 con 0x7fe1d409b470 2024-09-16T17:06:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.426+0000 7fe1c9ffb640 1 -- 172.21.15.59:0/29689956 <== mon.0 v2:172.21.15.59:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7fe1d0007e40 con 0x7fe1d409b470 2024-09-16T17:06:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe1b803e930 msgr2=0x7fe1b8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe1b803e930 0x7fe1b8040e40 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 msgr2=0x7fe1d409a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409a470 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 shutdown_connections 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.104:6800/3532556748,v1:172.21.15.104:6801/3532556748] conn(0x7fe1b803e930 0x7fe1b8040e40 unknown :-1 s=CLOSED pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 --2- 172.21.15.59:0/29689956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409b470 0x7fe1d409a470 unknown :-1 s=CLOSED pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 >> 172.21.15.59:0/29689956 conn(0x7fe1d40a3330 msgr2=0x7fe1d40a0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 shutdown_connections 2024-09-16T17:06:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-16T17:06:44.427+0000 7fe1db551640 1 -- 172.21.15.59:0/29689956 wait complete. 2024-09-16T17:06:44.441 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T17:06:44.441 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T17:06:44.441 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T17:06:44.441 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:44.514 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T17:06:44.514 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T17:06:44.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:44.608 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T17:06:44.609 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T17:06:44.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:44.695 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T17:06:44.695 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T17:06:44.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:44.775 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T17:06:44.775 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T17:06:44.775 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T17:06:44.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:44.805 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T17:06:44.805 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T17:06:44.805 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T17:06:44.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:44.820 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T17:06:44.820 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T17:06:44.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-16T17:06:44.890 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T17:06:44.891 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T17:06:45.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T17:06:45.077 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T17:06:45.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T17:06:45.160 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T17:06:45.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T17:06:45.265 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T17:06:45.342 INFO:tasks.ceph:Archiving mon data... 2024-09-16T17:06:45.343 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/data/mon.a.tgz 2024-09-16T17:06:45.343 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-16T17:06:45.360 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.VfQtqlOu5r 2024-09-16T17:06:45.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VfQtqlOu5r 2024-09-16T17:06:45.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.VfQtqlOu5r 2024-09-16T17:06:45.593 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.VfQtqlOu5r is 318KB 2024-09-16T17:06:45.687 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.VfQtqlOu5r 2024-09-16T17:06:45.702 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T17:06:45.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:06:45.744 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:06:45.822 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:06:45.838 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:06:45.838 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T17:06:45.839 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/remote/smithi059/crash 2024-09-16T17:06:45.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:06:45.887 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/remote/smithi104/crash 2024-09-16T17:06:45.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:06:45.946 INFO:tasks.ceph:Compressing logs... 2024-09-16T17:06:45.947 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:06:45.949 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:06:45.972 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T17:06:45.972 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95522.log 2024-09-16T17:06:45.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94235.log 2024-09-16T17:06:45.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29170.log 2024-09-16T17:06:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95848.log 2024-09-16T17:06:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29338.log 2024-09-16T17:06:45.976 INFO:teuthology.orchestra.run.smithi059.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94235.log.gz 2024-09-16T17:06:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95848.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29170.log.gz 2024-09-16T17:06:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94047.log 2024-09-16T17:06:45.976 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95848.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97136.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29338.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29172.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94047.log: /var/log/ceph/ceph-client.admin.97136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97010.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97136.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96136.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94047.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29172.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29448.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.97010.log: /var/log/ceph/ceph-client.admin.96136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95932.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97010.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96136.log.gz 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31088.log 2024-09-16T17:06:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94150.log 2024-09-16T17:06:45.978 INFO:teuthology.orchestra.run.smithi059.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29448.log.gz 2024-09-16T17:06:45.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95932.log: /var/log/ceph/ceph-client.admin.31088.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95932.log.gz 2024-09-16T17:06:45.978 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94412.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28215.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28255.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.28215.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28215.log.gz 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.28255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28166.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.28255.log.gz 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.28166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28295.log 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28166.log.gz 2024-09-16T17:06:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T17:06:45.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.28295.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.28295.log.gz 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96800.log 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94150.log: /var/log/ceph/ceph-client.admin.94412.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94150.log.gz 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96186.log 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94412.log.gz 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.1.log: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97260.log 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96800.log.gz 2024-09-16T17:06:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94304.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96186.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.97260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28574.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94304.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97260.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96234.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.94304.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.28574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29751.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.28574.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96842.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96234.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29751.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.95522.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97052.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96090.log 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.97052.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.96842.log.gz 2024-09-16T17:06:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94153.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.97052.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94012.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96090.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95323.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93329.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94153.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94152.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: 90.3%/var/log/ceph/ceph-client.admin.95323.log: -- replaced with /var/log/ceph/ceph-client.admin.94012.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95999.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92810.log 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95999.log: 88.3% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95999.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94152.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose 90.7% 94.1% -- replaced with /var/log/ceph/ceph-client.admin.93329.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31088.log.gz 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T17:06:46.010 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-client.admin.96213.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.92810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94049.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28860.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.95323.log.gz/var/log/ceph/ceph-client.admin.94049.log: 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96213.log.gz 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96519.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.28860.log: gzip -5 92.2% -- replaced with /var/log/ceph/ceph-client.admin.29751.log.gz 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94049.log.gz 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93253.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28860.log.gz 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29339.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96519.log.gz 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95869.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29339.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.93253.log.gz -5 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94048.log 2024-09-16T17:06:46.011 INFO:teuthology.orchestra.run.smithi059.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29339.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94010.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94048.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95869.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29171.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31030.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94010.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.94048.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29171.log: 84.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.94010.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94151.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3%/var/log/ceph/ceph-client.admin.31030.log: -- replaced with /var/log/ceph/ceph-client.admin.29171.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30996.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93138.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29490.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94151.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28885.log 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr: 90.1%/var/log/ceph/ceph-client.admin.29490.log: -- replaced with /var/log/ceph/ceph-client.admin.30996.log.gz 2024-09-16T17:06:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28804.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29490.log.gz 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31030.log.gz 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94149.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.28885.log: /var/log/ceph/ceph-client.admin.28804.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: 86.0%/var/log/ceph/ceph-client.admin.94149.log: -- replaced with /var/log/ceph/ceph-client.admin.28804.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96045.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28885.log.gz 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95095.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93138.log.gz 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94149.log.gz 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94805.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96884.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96045.log.gz 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95095.log: /var/log/ceph/ceph-client.admin.94805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93785.log 2024-09-16T17:06:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96884.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94236.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.96884.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95743.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93785.log: /var/log/ceph/ceph-client.admin.94236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29532.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95743.log: 87.4% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94236.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95743.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93785.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97220.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29532.log: gzip 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94805.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94340.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29532.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.97220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94758.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94340.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97220.log.gz 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93310.log 2024-09-16T17:06:46.014 INFO:teuthology.orchestra.run.smithi059.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.95095.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.94340.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28546.log 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27247.log 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93310.log: /var/log/ceph/ceph-client.admin.28546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94011.log 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28546.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.tmp-client.admin.27247.log: 67.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29340.log 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.27247.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.92810.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1%/var/log/ceph/ceph-client.admin.94011.log: -- replaced with /var/log/ceph/ceph-client.admin.93310.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96632.log 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96926.log 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29340.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94011.log.gz 2024-09-16T17:06:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95806.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96632.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96495.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95806.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.96926.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95806.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96446.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31049.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96495.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31164.log: /var/log/ceph/ceph-client.admin.96446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29070.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: 86.6%/var/log/ceph/ceph-client.admin.31049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92920.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96446.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96162.log 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31049.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.92920.log: gzip 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29070.log.gz 2024-09-16T17:06:46.016 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96716.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96046.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96162.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96716.log: gzip -5 --verbose -- 92.1% -- replaced with /var/log/ceph/ceph-client.admin.94758.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.96674.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96716.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97094.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96046.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94098.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.92920.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96674.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.97094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93397.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97094.log.gz 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93864.log 2024-09-16T17:06:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96339.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96360.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94098.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96020.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96360.log: gzip 87.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.28390.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96339.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96360.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93397.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96381.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96020.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.28390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93291.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.28390.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94482.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%gzip -5 --verbose --/var/log/ceph/ceph-client.admin.93291.log: /var/log/ceph/ceph-client.admin.96470.log 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96381.log.gz 2024-09-16T17:06:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31126.log 2024-09-16T17:06:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95827.log 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr: 90.4%/var/log/ceph/ceph-client.admin.96470.log: -- replaced with /var/log/ceph/ceph-client.admin.93291.log.gz 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31126.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96470.log.gz 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31126.log.gz 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-client.admin.96968.log 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94482.log.gz 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95827.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95827.log.gz 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95890.log 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96968.log.gz 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94303.log 2024-09-16T17:06:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96255.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31145.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95890.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94303.log: /var/log/ceph/ceph-client.admin.96255.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96255.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94303.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28944.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94099.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.28944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94339.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31145.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28944.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95954.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94099.log: /var/log/ceph/ceph-client.admin.94339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94988.log 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95954.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.93864.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94099.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95954.log.gz 2024-09-16T17:06:46.041 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% --verbose -- /var/log/ceph/ceph-client.admin.95718.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94339.log.gz 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94465.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96297.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95955.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95718.log.gz 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96297.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.94988.log.gz 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.94465.log.gz 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96297.log.gz 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94529.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.95955.log.gz 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95490.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.94529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94377.log 2024-09-16T17:06:46.042 INFO:teuthology.orchestra.run.smithi059.stderr: 86.4%/var/log/ceph/ceph-client.admin.95490.log: -- replaced with /var/log/ceph/ceph-client.admin.94529.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94100.log 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95490.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-client.admin.96425.log 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94100.log: /var/log/ceph/ceph-client.admin.94377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29337.log 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96425.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94377.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94100.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96425.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94546.log 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29337.log: /var/log/ceph/ceph-client.admin.94234.log 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94546.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29337.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95694.log 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94234.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94234.log.gz 2024-09-16T17:06:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92882.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95785.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95694.log: gzip/var/log/ceph/ceph-client.admin.92882.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96114.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95785.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.95694.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92882.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94546.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95785.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94413.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93272.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96114.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95764.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.94413.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94376.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95764.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93272.log.gz 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93101.log 2024-09-16T17:06:46.044 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95764.log.gz 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96276.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95668.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96276.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94376.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96318.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96276.log.gz 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95668.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93101.log.gz 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.95668.log.gz 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30220.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96758.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9%/var/log/ceph/ceph-client.admin.30220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29028.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96318.log.gz 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96758.log.gz 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97178.log 2024-09-16T17:06:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29028.log: /var/log/ceph/ceph-client.admin.28986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95911.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 86.3%/var/log/ceph/ceph-client.admin.97178.log: -- replaced with /var/log/ceph/ceph-client.admin.29028.log.gz 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97178.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29169.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.95911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93991.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95911.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.29169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93448.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29169.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96402.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.93448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94414.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.96402.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.93991.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96402.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28311.log 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.94414.log: /var/log/ceph/ceph-client.admin.28311.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94414.log.gz 2024-09-16T17:06:46.046 INFO:teuthology.orchestra.run.smithi059.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28311.log.gz 2024-09-16T17:06:46.047 INFO:teuthology.orchestra.run.smithi059.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.93448.log.gz 2024-09-16T17:06:46.047 INFO:teuthology.orchestra.run.smithi059.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.30220.log.gz 2024-09-16T17:06:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.3.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T17:06:46.463 INFO:teuthology.orchestra.run.smithi059.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz 2024-09-16T17:06:47.618 INFO:teuthology.orchestra.run.smithi059.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T17:06:52.053 INFO:teuthology.orchestra.run.smithi104.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T17:06:52.212 INFO:teuthology.orchestra.run.smithi104.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T17:06:52.214 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-16T17:06:52.214 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m6.250s 2024-09-16T17:06:52.214 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m12.018s 2024-09-16T17:06:52.215 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.482s 2024-09-16T17:06:52.544 INFO:teuthology.orchestra.run.smithi059.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T17:06:52.898 INFO:teuthology.orchestra.run.smithi059.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T17:06:52.900 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-16T17:06:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m6.938s 2024-09-16T17:06:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m15.167s 2024-09-16T17:06:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.641s 2024-09-16T17:06:52.900 INFO:tasks.ceph:Archiving logs... 2024-09-16T17:06:52.900 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/remote/smithi059/log 2024-09-16T17:06:52.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:06:55.325 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/remote/smithi104/log 2024-09-16T17:06:55.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:06:57.315 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T17:06:57.324 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T17:06:57.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:06:57.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:06:57.405 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T17:06:57.413 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T17:06:57.414 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:06:57.416 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:06:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:06:57.433 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:06:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:06:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-16T17:06:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -283us[ -280us] +/- 41ms 2024-09-16T17:06:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -29us[ -26us] +/- 75ms 2024-09-16T17:06:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +502us[ +505us] +/- 64ms 2024-09-16T17:06:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:06:57.439 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:06:57.439 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-16T17:06:57.439 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -293us[ -287us] +/- 41ms 2024-09-16T17:06:57.439 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -29us[ -29us] +/- 75ms 2024-09-16T17:06:57.439 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 40 +504us[ +504us] +/- 64ms 2024-09-16T17:06:57.440 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:06:57.440 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T17:06:57.449 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T17:06:57.449 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T17:06:57.457 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:06:57.548 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:06:57.612 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:06:57.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:06:57.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:06:57.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:06:57.672 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T17:06:57.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T17:06:57.689 INFO:teuthology.task.internal:Duration was 1866.448996 seconds 2024-09-16T17:06:57.690 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T17:06:57.737 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T17:06:57.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:06:57.740 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:06:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:06:57.781 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:06:58.073 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T17:06:58.073 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-09-16T17:06:58.073 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:06:58.118 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-09-16T17:06:58.118 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:06:58.139 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T17:06:58.139 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:06:58.161 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:06:58.206 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T17:06:58.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:06:58.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:06:58.342 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T17:06:58.352 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T17:06:58.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:06:58.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:06:58.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T17:06:58.411 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:06:58.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:06:58.443 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-09-16T17:06:58.465 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-09-16T17:06:58.484 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:06:58.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:06:58.516 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:06:58.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:06:58.538 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T17:06:58.548 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T17:06:58.549 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/remote/smithi059 2024-09-16T17:06:58.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:06:58.591 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907361/remote/smithi104 2024-09-16T17:06:58.591 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:06:58.624 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T17:06:58.624 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:06:58.628 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:06:58.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T17:06:58.685 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T17:06:58.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T17:06:58.694 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T17:06:58.694 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:06:58.697 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:06:58.709 INFO:teuthology.orchestra.run.smithi059.stdout: 265602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:06 /home/ubuntu/cephtest 2024-09-16T17:06:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:06 /home/ubuntu/cephtest 2024-09-16T17:06:58.730 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T17:06:58.739 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T17:06:58.765 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} duration: 1866.4489960670471 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T17:06:58.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T17:06:58.829 INFO:teuthology.run:pass